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Abstract. A connection between representation of compact groups and some 
invariant ensembles of Hermitian matrices is described. We focus on two types 
of invariant ensembles which extend the Gaussian and the Laguerre Unitary 
ensembles. We study them using projections and convolutions of invariant 
probability measures on adjoint orbits of a compact Lie group. These measures 
are described by semiclassical approximation involving tensor and restriction 
muUtiplicities. We show that a large class of them are determinantal. 

Resume. Nous decrivons les liens unissant les representations de groupes com- 
pacts et certains ensembles invariants de matrices aleatoires. Get articles porte 
plus particulierement sur deux types d'ensembles invariants qui generalisent les 
ensembles gaussiens ou de Laguerre. Nous les etudions en considerant des con- 
volutions ou des projections de probabilites invariantes sur des orbites adjointes 
de groupes de Lie compacts. Par approximation semi-classique, ces mesures 
sont decrites par des produits tensoriels ou des restrictions de representations. 
Nous montrons qu'une large classe d'entre elles sont determinantales. 



1. Introduction 

One of the first aims of random matrix theory (RMT) is computation of eigen- 
value distributions. Its first appearance is in statistics in 1928, when Wishart [63] 
has determined the maximum hkehhood estimator of the covariance matrix of a 
Gaussian vector. In 1951, Wigner [62] introduced random Hermitian matrices in 
physics, with the idea that their eigenvalues behave as the high energy levels of hard 
nucleus. Up to now, in this very active field of research, the detailed analysis of 
these eigenvalues most often rests on the explicit determinantal expression of their 
distribution, see, e.g. Mehta [3T. Although these distributions are usually obtained 
by more or less easy applications of the change of variable formula, it has been no- 
ticed that they contain expressions familiar to the theory of group representations. 
Actually, many tools from this theory occur in RMT: for instance Young tableaux, 
Harish-Chandra-Itzkinson-Zuber formula, symmetric spaces, and so on. 

The purpose of this paper is to establish a direct link between classical compact 
groups and RMT and to use it to compute the distributions of some new ensembles. 
On the one hand it gives expressions which are maybe not so easy to obtain directly. 
On the other hand, and more importantly, it explains the frequent occurrence of 
concepts from representation theory in some aspects of random matrix theory. 

The main idea is simple. Roughly speaking, the ensembles we will consider are 
invariant under the action of a unitary group by conjugacy. Computations will 
use ultimately a detailed description of the images of the Haar measure on orbits 
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under the adjoint action. They are caUed orbit measures. In the spirit of Kir- 
iUov's orbit method, these measures are obtained by semi-classical approximation 
as limit of the empirical distribution of the weights of irreducible representations 
of high dimension. For RMT, the quantities of interest will be expressed either 
by sums or by projections of orbit measures. We will compute them using tensor 
products or restrictions of representations. This latter computation will be made in 
a combinatorial-geometric manner, by using Kashiwara crystal theory, which can 
be viewed as a recent and deep generalization of Young tableaux. 

The paper is divided into two parts. We will describe the theoretical approach 
only in the second part, because it uses algebraic machinery which can scare some 
readers. 

The first part is devoted to its application to concrete problems in RMT. To 
illustrate our approach, we study some non classical ensembles of Hermitian com- 
plex matrices. They will be either the set of all n x n Hermitian matrices denoted 
below P„(C), or the set of skew-symmetric Hermitian matrices denoted or 
the set of Hamiltonian Hermitian matrices denoted 7'„(]HI). The reason of these 
maybe strange notations is the following. Let F = M, C or EI be either the field of 
reals or complex or quaternions numbers. The so called classical compact groups 
are the neutral components ?7„(F) of the unitary groups. If iLai^) is the Lie al- 
gebra of Un (F) , then Vn (F) = (F) is a subset of the set of Hermitian matrices 
with complex entries. They correspond to the so-called classical flat symmetric 
spaces associated to the complex semisimple groups. In RMT they occur in the 
Atland-Zirnbauer classification [1], but among them only 7^,i(C) occurs in the Dyson 
threefold way [21j . As usual in physics, we are interested in ensembles invariant 
under an appropriate group of symmetry. So we will look at random Hermitian 
matrices in Vni^) whose laws are invariant under conjugation by the elements of 
the compact group t/„(F). Recall that in RMT an ensemble is a random matrix. 

Definition 1.1. A random matrix, or an ensemble, M with values in 7^,i(F) is 
called invariant if its distribution is invariant under conjugation by [/„(F). 

It is for these ensembles that representation theory plays a role. Among them, 
a pre-eminent role is played by the family of ensembles which form a projective 
series as n increases. Indeed, in physical applications the finite dimension n is only 
an approximation. It is interesting to notice that these series admit a complete 
description, in the spirit of De Finetti's theorem. We will give it in section 2, 
by applying a remarkable result of Pickrell [54]. They are obtained as a "double 
mixture" of two simple types of ensembles that we call GUE(F) and LUE(F). The 
classical GUE and LUE (Gaussian and Laguerre Unitary ensemble) are obtained 
for F = C. Notice that when F = K and F = H they are not finked with the GOE 
and the GSE nor the LOE and LSE. Actually GUE(M) is in the class D of Altland 
and Zirnbauer [1], and GUE(]HI) is in their class C. In the spirit of random matrix 
theory one can say that they are all in the (3 — 2 family. Some of their applications 
will be recalled in 12.41 

As a first application of the introduced method we compute in section 3 the 
distribution of the main minors of an invariant random matrix. We show that the 
eigenvalues of the successive main minors of an invariant random matrix in 7^„(F) 
with given eigenvalues have the uniform distribution, or a projection of it, on a 
conveniently defined Gelfand-Tsetlin polytope, which describes their interlacing. 
This was first proved for Pn(C) by Baryshnikov [2], by a different method, motivated 
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by queuing theory. We use the approximation of projections of orbits detailed in 
7.3. Notice that the role of Gelfand Tsetlin patterns in the study of shape process 
already appeared in Cohn, Larsen and Propp [14 . 

As a second application, we study the LUE(F). These ensembles can be written 
as MflM* where M is a standard Gaussian matrix with entries in F and is a 
simple fixed appropriate matrix. For instance = I when F = C. The result 
of Pickrell mentioned above show that they are a building block in the harmonic 
analysis of infinite Hermitian matrices in the spirit of Olshanski and Vershik [53] , 
Olshanski fS^, Borodin and Olshanski [B] for instance. Moreover, we will see that 
radically new phenomenon occur when F is not equal to C, so that this study 
is interesting in itself. In sections 4 and 5, we determine the distribution of the 
eigenvalues. In section 4, one considers the case where fl is of rank one and analyse 
the perturbation of any matrix in 7^n(F) by such a random matrix. This rests on 
the theoretical results of the second part on tensor products of representations. The 
general case is considered in section 5. 

In section 6, considering the minor process associated to some invariant ensem- 
bles and successive rank one perturbations, we obtain two types of interlaced point 
processes, called "triangular" and "rectangular" . We deduce from the description 
given in sections 3, 4 and 5 that a large class of them are determinantal. This shows 
that these interlacings exhibit repulsion. In the GUE case, this was also proved re- 
cently by Johansson and Nordenstam [35] , and Okounkov and Reshetikhin [49^ . 

After a first part devoted to applications we develop in the second part of this 
paper the tools coming from representation theory used to establish them. In 
section 7, we present a variant of a theorem of Heckman which allows us to describe 
in a precise way convolutions and projections of adjoint orbit measures, once we 
know the so called tensor or branching rules. For our applications these rules are 
described in section 9. They are classical and simple in the case when F = C, but 
more involved in the other ones. Actually we only need a geometrical description of 
these rules and not their combinatorics as usual. This is quite remarkable. These 
geometric descriptions are easily and directly obtained using Kashiwara crystal 
theory. As explained in section 9, crystal theory gives us a description in terms of 
non-intersecting paths, or interlaced points, which is exactly what we need. Finally 
in section 10, we apply the results obtained in this second part to the context of 
RMT described in the first part. 

One can find in the litterature different versions of the theorem of Heckman. 
For instance, Collins and Sniady gave one recently in |15| . in the framework of 
noncommutative probabilities. Their approach consists in considering a random 
matrix as a limit of random matrices with non-commutative entries. While finishing 
to write this paper announced in [16', Forrester and Nordenstam [25 posted an 
article in arxiv dealing with the GUE(]R) case. 

Notation 1.2. In this paper, for an integer n we will write 



We let c = I i/F = C, M, c — 2 i/F = H and e = 1 if n is odd and otherwise. 




n when F = C and H 

[n/2\ when F = M. 
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Part 1. Random matrices 



2.1. Some invariant set of Hermitian matrices. The set 7^„(C) oi n x n Her- 
mitian matrices is the real vector space of complex matrices M such that M* = M , 
where M* is the adjoint of M . Many classical ensembles considered in physics 
occur on subsets of Vn (C) . Let us distinguish three important classes which occur 
as flat symmetric spaces associated with compact groups, or equivalently complex 
semi-simple groups, and are thus of the so called (3 — 2 type. They have been 
introduced in the literature under various names. Our choice is due to the fact that 
we want to have a common setting for all of them. 

The first set we consider is 7'„(C) itself. The second set is the set 7^,i(K) of 
Hermitian complex matrices M which can be written as M = iX where X is a real 
matrix. In this case X is skewsymmetric (i.e. X + X* = 0). Thus 7'„(K) is just a 
convenient parametrization of the set of skewsymmetric real matrices, studied for 
instance by Mehta [47] . 

In order to introduce the third one, we first define the C-symmetry class of 
Atland and Zirnbauer [1] . It is the set of complex Hermitian matrices Ti. which can 
be written as 



where H and S are two n x n complex matrices, with H Hermitian and S sym- 
metric. In other words it is the set of Hermitian matrices of the Lie algebra of the 
complex symplectic group. One recognizes the form of the Bogoliubov-de Gennes 
Hamiltonian in condensed matter physics (see below). Actually we will use a more 
convenient representation by using quaternions. For us, the set H of quaternion is 
just the set of 2 x 2 matrix Z with complex entries which can be written as 



where a, 6 G C. Its conjugate Z* is the usual adjoint of the complex matrix Z. We 
define 7'„(H) as the set of 2n x 2n complex Hermitian matrices M which can be 
written as M ~ iX where X i& a. n x n matrix with quaternionic entries. Let W 
be the matrix of the permutation of C^": 

{xi,X2,- ■ ■) ^ (a;i, a;„+i, a;2, x„+2, a^s, • • ■ )• 
Then TL is an Hamiltonian given by llj if and only if 



is in 7'„(H). Therefore Vnifi) is just a parametrization of the class C of Altland 
and Zirnbauer. Notice that the matrices of the GSE are not of this type since they 
are self dual matrices with entries in H. We can thus define: 

Definition 2.1. For F — R, C,]HI, P„(F) is the set of n x n Hermitian matrices 
with entries in i¥. 



2. Ensembles of Hermitian matrices 



(1) 





(2) 



n = wnw 
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One recognizes in 7'„(F) the three infinite families of Cartan motion groups 
associated with compact (or complex) groups. Indeed, let C/„(F) be the neutral 
component of the group of unitary matrices with entries in F. Its Lie algebra 
il,i(F) is the set of matrices M with entries in F such that M + M* = 0. Then 
7'„(F) ~ iil„(F), and the Cartan motion group associated with C/„(F) is 

G-C/„(F) x,n.(F) 

where J7„(F) acts on 7'n(F) through a by conjugation (i.e. by adjoint action). In 
the classification of symmetric spaces, 7^„(C) is said to be of type A and C/„(C) is 
the unitary group. When n — 2r, 7^„(M) is of type D and when n = 2r + 1, 7^„(M) 
is of type B, and ?7,i(K) is the special orthogonal group SO{n) in both cases. At 
last, 7^,1(111) is of type C and ?7,i(IHI) is the symplectic unitary group Sp{n). 



2.2. Eigenvalues and radial part. Consider a matrix M in 7',i(F). Since M is 
an Hermitian complex matrix, it has real eigenvalues Ai > A2 > • ■ • > A„ when 
F = R and C, and Ai > A2 > • • • > A2„ when F = H. When F = C there is no 
further restriction, but when F = R, then \n-k+i = ^Afe, for fc = 1, • • • ,n + 1, 
which implies \n+i = when n is odd (Recall that n — [n/2] when F — R). When 
F = H then A2ri-fc+i = — Afe, for fc = 1, • • • ,n. We define the Weyl chambers C„ in 
the different cases by : when F = C, 



when F 



when F — 



when . 



C„ = {AeM";Ai>A2>--->A„}, 
and n is odd, 

C„ = {A e M"; Ai > A2 > • • • > Aft > 0}, 
and n is even (see Remark |2.3|) . 

C„ = {A e M"; Ai > A2 > • • • > Xn-i > \Xn\ > 0}, 



r 



{A e M";Ai > A2 > • • • > A„ > 0}. 



The Weyl chamber is a fundamental domain for the adjoint action of J7,i(F) on 
P„(F). More precisely, let us introduce the following matrices. For F = C, and 
A — (Ai, • • • , A„) in M", we denote by ri„(A) the n x n diagonal matrix 



n„(A) 



V 



A.J 



When 



I, we let u!{a) 



where a € R, and for A G M", we write 



I a ' 
-ia 

fin (A) for the n x n block-diagonal matrix given by, when n is even. 



^w(Ai) 
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and when n is odd, 



r!„(A) 



When 



and A = (Ai, ■ 



V 

,A„) in M", 
^Z(Ai) 



0/ 



we let 



Z{Xn). 





—a 



Then it is weh 



where, for a e M, Z{a) is the 2x2 matrix Z{a) — j 
known and not difhcuh to prove that: 

Lemma 2.2. Let M he a matrix in 7^„(F). Then there exists a unique A G C„ and 
a matrix U G Un{¥) such that 

We call X the radial part of M and will denote it by X — X^'^\M). 

This is the so cahed radial decomposition of M in the flat symmetric space 
7'„(F). We see that in each case 

{kMk*,k e C/„(F)} n {Qniii), fie C„} = {r!„(A)}. 

Remark 2.3. The definition of Cn when F = M and n is even may look strange. 
Actually, in this case both Xn and —Xa are eigenvalues, so Ai, • • • , Afi_i, |Afi| is the 
set of positive eigenvalues. But one has to take this Cn to have the lemma above. 

2.3. Infinite invariant ensembles. We have defined an invariant random matrix 
(or invariant ensemble) in 7'n(F) as a random matrix with values in 7'„(F), whose 
distribution is invariant under conjugation by J7„(F). There are of course many 
such matrices. Actually it is well known that one has the following lemma. 

Lemma 2.4. A random matrix M with value in 7^„(F) is invariant if and only if it 
can he written as M — C/il„(A)C/*, where U € Uni^) and A g C„ are independent 
random variahles, U having the Haar distribution. 



Proof The lemma O allows us to write M = [/ri„(A)C/*, with U G t/„(F) and 
A € C„. Let V G J7n(F) be a Haar distributed random variable independent of M. 
Then M as the same distribution as {VU)fln{A){VU)* . The Haar measure being 
invariant by multiplication, this has the same law as VQni-^)V* . □ 

Two important classes of invariant random matrices in 7'„(F) are to be distin- 
guished. The first one is the class of ergodic measures. An invariant probability is 
called ergodic if it cannot be written as a barycenter of other invariant probabilities. 
On VnC^) the ergodic invariant measures are the orbit measures, that is the law 
of Unn{X)U* when U has the Haar distribution and A is fixed in Cn- The second 
class is linked with Random Matrix Theory. Actually, in that case one is interested 
in a family Vn of probability measures on 7'n(F) which forms a projective system 
as n groes, and thus defines a probability measure v on the set Poo(]F) of infinite 
Hermitian matrices. More precisely, for F = R, C or H, let 7^oo(F) be the set of 
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matrices {Mk,i, I < k,l < +00}, with entries in i¥ such that Mi^k — For each 

n £ N, J7„(F) acts on Voci^)- A probabihty measure on Voc{¥) is cahed invariant 
if it is invariant under the action of each C/„(F). 

It is remarkable that, following Pickrell _54J and Olshanski and Vershik [53], one 
can describe explicitly the set of invariant measures. As in De Finetti's description, 
each of this measure is obtained as a mixture of ergodic ones, and each ergodic one 
has a product structure : the diagonal elements form an i.i.d. sequence (see below). 
In order to describe them let us introduce the two basic ensembles on Vco (F) . 

Let us denote A4n,m{P) the set of n x m matrices with entries in F. It is a real 
vector space. We put on it the Euclidean structure defined by the scalar product, 

{M, iV) = a Re tr(Af TV* ) , M, iV e 7W„,™ (F) , 

where a = 1 for F = M, and a = 2 for F = C, H. Recall that a standard Gaussian 
variable on a real Euclidean space with finite dimension c? is a random variable with 
density 

(2^)-'^/2e-(-^->/2. 

Our choice of the Euclidean structure above defines a notion of standard Gaussian 
variable on A1„^,„(F). Taking m = n = I this defines standard Gaussian variables 
in F itself. We equip the real vector space Vn (F) with the scalar product 

(M, N) tr{MN) , M, N e Vn (F) , 

where 6=1 when F = C and 6 = 1/2 when F = M, H, and thus define a standard 
Gaussian variable on 7'„(F). 

We have defined above, for each choice of F, the matrix Vln{X) for A G C„. For 
k < fi, we let 

(3) cif; = i7„(i,... ,i,o,---o) 

where 1 appears k times, and, when 1 appears h times, we let 

(4) n.n = K = W,-A)- 

Definition 2.5. For F = K, C or H, and k,neN, we define 

1. The ensemble GUEn{¥) as the set of matrices in 7'„(F) with the standard 
Gaussian distribution. 

2. The ensemble LUEn^ki^) as the set of matrices MVLkM* when M is a standard 
Gaussian random variable m A^„^fc(F). 

Notice that if the matrices of the LUE„ _fc(F) may look strange, their Fourier 
transform does not (recall that k — k when F = C,H and k = [fc/2] when F = M, 
and that c = 1 when F = C, M and c = 2 when F = H): 

Lemma 2.6. Let M be a standard Gaussian random variable in Al„.fe(F). Then 
the Fourier transform of MflkM* is given by 

me~^{NMn,M')-. ^ ^^^^j _^ -N)-'', N e ^.(F). 

c 

Proof. As MilkM* is invariant, it is enough to prove the identity for N — r2„(A), 
with A e C„. When F = C, 

n k 

{N, AmkM*) ^J2Y1 ^^l^^jf ' 
i=l j=l 



8 



MANON DEFOSSEUX 



where Mij are independent standard Gaussian complex r.v.. We have, for all a G M, 

E(e-'"l^i,il') ^ -J—^ 
^ ' l + ia 

which gives the complex case. When F H, 

n j 

i=i j=i 

where the matrices ) are independent standard Gaussian variables in 

]g^g-m(|ai,ip-|6i,i|^)-j _ 



We have, 



1 



l+(f)" 



which gives the quaternionic case. When F = 



k 



i=l j=l 

where the M^j 's are independent standard real Gaussian variables. We have 



which gives the real case. □ 

When F = C we obtain the classical LUE, called the Laguerre Unitary or Com- 
plex Wishart ensemble, which is carried by the cone of positive definite matrices. 
The situation is completely different for the fields K and H: in these cases the 
Fourier transform 



det(/ + -iV)-'= = det(/ + 



c c- 

is real, and therefore the distribution of a random matrix of the LUE(F) is sym- 
metric. Actually the support of A/f2„Af* is the whole of P„(F). Observe that in 
the cases when F = H and F = M with n odd, all the invariant measures on 7'„(F) 
are symmetric. 

Let us give a justification for the introduction of these invariant ensembles. We 
define the set LUE;^(F) as the set of matrices MfJ^M* with M G A^oo(F) such 
that the submatrices {Mij, i,j = 1, • • • ,n} are standard Gaussian variables in 
A^„(F) and the set GUEoo(F) as the set of matrices M e Poo(F) such that the 
submatrices {Mij, i,j — 1, • • • ,n} are standard Gaussian variables in 7^„(F). A 
random matrix in Voo (^) is called invariant if its law is invariant under the action 
of each [/^(F). As will be clear from the proof, the following theorem is essentially 
contained in Pickrell [SJ. It can be useful to notice that the intuition behind this 
result is the fact that limit of orbit measures are of this type, by Borel's theorem 
recalled below. 



Theorem 2.7. Each ergodic invariant random matrix M in Voci^) is sum of 
elements of GUE^(¥) and LUE^(¥): it can be written as 



+ 00 



M = al + bG + ^ dkLk 



k=l 
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where G belongs to GUEoo{^), Lk belongs to LUE}^(¥), the random variables 
G, Li, L2 ■ ■ ■ are independent, and a,b,dk are constants such that "^d^ < +00, 
I is the identity matrix. Moreover a = when F = M and F = H. 

Proof. The proof will use Olshanski spherical pairs, see Olshanski [50l[5T] or Faraut 
[23j . Given a topological group G and a closed subgroup K, one says that (G, K) 
is an Olshanski spherical pair if for each irreducible unitary representation tt of G 
in an Hilbert space H, the space {u e H; n{k)u — u, for all k € K} is zero or one 
dimensional. For instance, an inductive limit of Gclfand pairs is an Olshanski pair. 

The dual of the vector space Vooi^) is the inductive limit of the 7'„(F)'s, which is 
the set p(°°)(F) of matrices M in VodV) such that Mij = for i + j large enough. 
Each t/„(F) acts on V^^^^W) as on VooiV). Let f/(°°')(F) be the group inductive 
limit of the ?7„(F)'s. Recall the radial decomposition 7^„(F) = {Uiln{X)U* ,U E 
?7„(F), A G Cn}- Let A = (Ai, A2, • • • ) be an infinite sequence of real numbers, with 
Afc = for k large enough. In this case, we write instead of iloo(A). Notice 

that each matrix of V^'^'HW) can be written as Un{X)U* for an U e U^°°H¥) and 
such a A. 

As inductive limit of Gelfand pairs {U^°^'\¥) x„ V^°°H¥),U^°°H¥)) is an Ol- 
shanski pair. Therefore, by the so-called multiplicative property of Voiculescu and 
Olshanski (see Olshanski f5T|, Pickrell [54]) an invariant probability measure ly on 
7^00(1^) is ergodic if and only if its Fourier transform ^ on V^°°\¥) is a positive 
definite invariant function such that, for some function : R — )■ C, 

V'(l^(Ai,A2,...)) =0(Ai)0(A2)--- 

for all A as above. When F = C it is proved in Pickrell [54] (see also Olshanski and 
Vcrshik '53]) that there exist unique real numbers a,b > and dk,k > 1, such that 
for all t e M, 

00 

(5) (Pit) = e^'^'e-^*' n [(1 + tdkt)e''''T^. 

k=l 

Therefore the theorem holds when F = C. We now consider the case where F = M, 
following an idea in Pickrell '54]. To any complex matrix M S 7^(°°) (C) we associate 
a matrix f{M) G V^°°\R) by replacing each entry m = x + iy, x,y € R oi M hy 
the 2x2 matrix 

rh = ('y ^^V 

\-ix lyj 

For all A ~ (Ai, A2, • • • ): fi^W) = i^(A) where Q, is, on the left hand side, the one 
defined for F = C and on the right hand side the one defined for F = R. 

Consider an ergodic invariant probability measure on VaoiR) and let if) be its 
Fourier transform defined on 7''°°)(M). Then -0 is invariant and positive definite 
and by the multiplicativity theorem there exists, as above, a function (/> : R — > C 
such that 

V'(l^(Ai,A2,...)) -0(Ai)0(A2)--- 

The function ipof on (C) is obviously positive definite and invariant. Moreover, 
since f oVL = 0, one has 

(V'o/)(r!(Ai,A2,---)) =0(Ai)</>(A2)--- 

Therefore by the sufficient condition of the multiplicativity theorem, ij} o f \s the 
Fourier transform of an ergodic invariant probability measure on ■Poo(C). Thus (j) 
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can be written as ([5|) above. Moreover, the function ip is invariant under the groups 
[/„(]R) = SO{n). Using the adequate reflection in 50(3), we see that 

V'(f^(Ai,A2,---)) = V'(^^(-Ai,A2, •••))• 
Therefore, for all t G M, — which implies by uniqueness that, 

OQ 

k=l 

Using the expression of the Fourier transform given in Lemma 12.61 we obtain the 
theorem in the case F = M. When F = IH the proof is similar: one uses the map 
/ : 7'(°°)(C) 7'(°°)(H) defined in the foUowing way. First, we define /„ : ^^(C) ^ 
P„(H), by when M e 'P„(C) and W is given by Q, 

fniM) - W (^^^ _y W* e P„(H). 

For M e V^°°''{M), let 7r„(M) be its main minor of order n. The fact that 
^„(/„+i(^„+i(M))) = /„(7r„(M)) allows us to define / : M e 7'(°-)(C) /(A/) e 
p(°°)(H) by 7r„(/(M)) = /n(7r„(M)). We also have /o = rj. The symmetry 
A i-^ — A given by the action of UnCH) allows us to conclude as when F = K. 



2.4. Symmetry classes and some applications. Let us recall the three main 
historical steps in the description of the ten symmetry classes, i.e. series of classical 
symmetric spaces, in physical applications of RMT, see Atland and Zirnbauer [T], 
Caselle and Magnea [13], Forrester [24], Heinzner, Huckleberry, and Zirnbauer [32] . 
We refer to the symmetry classes by Cartan's symbol for the symmetric space corre- 
sponding to their Hamiltonians. The first step is the introduction of the "threefold 
way" by Dyson [21] in 1962 where are defined the GUE (class A), the GOE (class 
AI) and the GSE (class All), often called the Wigner-Dyson classes. They describe 
for instance single particle excitations in the presence of a random potential. In 
the 90's, Altland and Zirnbauer [1] have defined the classes BD, C, Dili and CI to 
describe mesoscopic normal-superconducting hybrid structures: for instance a nor- 
malconducting quantum dots in contact with two superconducting regions. They 
are sometimes called the Altland-Zirnbauer, or Bogoliubov-de Gennes, or Super- 
conductor classes. At least chiral classes AIII (LUE), BDI (LOE) and CII (LSE) 
were introduced by Verbaarschot [59] to describe Dirac fermions or systems with 
purely off-diagonal disorder, as in random flux models. The explicit description 
of the distribution of the eigenvalues in all these classes is given for instance in 
Forrester [24] or in Eichelsbacher and Stolz [22] . 

In our ensembles /3 — 2, and thus only the classes A,B,C,D,AIII occur. Let 
us for instance recall rapidly how the new classes C and D appear in quantum 
mechanics. Dynamics of the systems of the Wigner Dyson class is given in term of 
second quantization. For the superconductor classes, one convert this set up into 
first quantization by using the Bogoliubov-de Gennes Hamiltonian. As explained 
in Atland and Zirnbauer [T], this Hamiltonian acts on a 2n-dimensional Hilbert 
space by a complex Hermitian matrix Ti. which can be written as 
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where H and A are n x n matrices. Let Uq be the 2n x 2n unitary matrix, block 
diagonal with each diagonal block equal to 



in other words Uq = uq® In- Then X = UoHUq^ is in V2n{^) and each matrix in 
7'2ri(K) is of this form. This shows that 7^271 (R) is a parametrization of the class D 
of Altland and Zirnbauer. 

If we add spin rotation invariance the BdG Hamiltonian can be written (see [T]) 
as two commuting subblocks of the form 



This is the class C of Altland Zirnbauer. As seen above, P„(H) describes this set. 
Notice also that the GUE(M), or equivalently the antisymmetric case, was already 
studied as soon as 1968 by Rozenbaum and Mehta in [15]. Recently it also occurs 
for instance in Cardy [H] and Brezin et al. [51 [TO] for instance. 

When F = M and H, the eigenvalues of the matrices in P„(F) come in pairs 
symmetric with respect to the origin (this is sometimes linked with Kramers de- 
generacy). So in a sense there is a presence of a wall at 0. This often explains 
their occurences in applications, see for instance Krattenthaler et al. [45| , Katori et 
al. [3H113S], Gillet [12], Forrester and Nordenstam [H]. The LUE(C) is in a chiral 
class, but not the LUE(R) nor the LUE(H) which appear to be new and for which, 
we are not aware of any physical application. 



In this section, we compute the joint distribution of the main minors of invariant 
random matrices in 7'„(F). For M = {Mij, 1 < *, j < ^t-} in P„(F) and k < n, the 
main minor of order k of M, is the submatrix 



(this is not the standard definition of a minor: usually it is the determinant of a 
submatrix of M, and not the submatrix itself). The main minor of order k of Al 
belongs to ■Pfc(F), so we can consider its radial part denoted X('^^(Af). Considering 
the radial parts of all the main minors of an invariant random matrix in Vn (F) , we 
get a random variable. 



which is, when F is equal to C, and M £ 7^n(C) is a matrix from the GUE, the one 
introduced by Baryshnikov in relation with queuing theory in [2], and called the 
minor process by Johansson and Nordenstam in |35| . The main result of this section 
is stated at theorem 13.41 It claims that for any F, the minor process associated to 
an invariant random matrix with a fixed radial part, is distributed according to 
the uniform law, or a projection of it when F = H, on a so called Gelfand-Tsetlin 
polytope. 

Our proofs rest on results given from sections 7 to 10, which involve elements 
of representation theory of compact Lie groups. In this section, our statements are 
made without any reference to this theory and most of the proofs are postponed 
up to the section 10. 





3. Minors and Gelfand-Tsetlin polytopes 



TTkiM) = {My, l<l,j<k} 



X{M) = (X(i'(Af),- • • ,X(")(A^)), 
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When M is a complex Hermitian matrix, Rayleigh's theorem claims that if A G 
R" is the vector of the ordered eigenvalues of M and if /3 e M"^^ is the one of its 
main minor 7r„_i(Af) of order n — 1, then A and (3 satisfy interlacing conditions 
Ai > A > Aj+i, i = 1, ■ ■ ■ ,n — 1. Obviously this result also holds when M belongs 
to 7'„(R) and ^^(EI), these sets being subsets of complex Hermitian matrices. Thus 
for F = C, K, one obtain easily that X{M) belongs to the so called Gelfand-Tsetlin 
polytopes, that we define below. We will see after these definitions what happens 
for F = H. For x,y £ R" we write x ^ y ii x and y are interlaced, i.e. 

Xl > yi > X2 > ■ ■ ■ > Xn > Vn 

and we write x >- y when 

Xl > yi > X2 > ■ ■ ■ > Xn > y„. 

When X e M"+^ and y E R" we add the relation ?/„ > Xn+i (resp. ?/„ > Xn+i)- We 
denote the vector whose components are the absolute values of those of x. 

Definition 3.1. Let A be in the Weyl chamber Cn- The Gelfand-Tsetlin polytope 
GTn{X) is defined by : 

• when F = C, 

GT„(A) = {{x^^\--- : a;(") = \,x^''^ € R^ x^^^ h x^''-^\l < k < n}, 

• when F^M, 

^(fe)^ 2.(fc-|) igfc^ 2.(fe) ^ ^.(fe-i) ^ a;(fc-i)^i < k < n}, 

• when ¥ = R, 

GTn{\) = {(a;(i),- • • ,a;(")) : a;(") = A,^^^) e R^^i X R w/ien /c 2i, 

0, x^^) e R; w/ien fc 2i + 1, \x'^^^ \ >z \x'^''^^'>\,l <k<n}. 

If M is a matrix in 7'„(1I) such that (A/) = A, then X{M) belongs to the im- 
age of GT„(A) by the map {x^^\x^^\--- e Gr„(A) {x^^\x^^\--- 
To prove it, we can consider for instance, for r = 1, • • • , n, the vector X*^''^2)(Af) £ 
MJ" whose components are the ordered absolute values of the r largest eigenvalues 
of the main minor of order 2r — 1 of Af considered as a matrix from 7^271 (C). Then 
Rayleigh's theorem implies that 

(X(^'(Af),X(i)(A//),-- - ,X("-3)(Af),X(")(Af)) 

belongs to the Gelfand-Tsetlin polytope GT„(A) of type H, which gives the an- 
nounced property. 

Usually, an element a; of a Gelfand-Tsetlin polytope, is represented by a trian- 
gular array, called Gelfand-Tsetlin array, as indicated from figures [T] to ID 

Let us say what is meant by the uniform measure on a Gelfand-Tsetlin polytope. 
It is a bounded convex set of a real vector space. As usual, we define the volume of 
a bounded convex set C as its measure according to the Lebesgue measure on the 
real afhne subspace that it spans. We denote it vol(G). We define the Lebesgue 
measure on G as this Lebesgue measure restricted to C and the uniform probability 
measure on G as the normalized Lebesgue measure on C. 
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An-l) (n-1) (n-1) (n-1) 

•''1 •''2 

f"! ■''2 •''ra— 1 

Figure 1 . A Gelfand-Tsetlin array for F = C 





3 ^l'^ 3 3-^1'^ 

( 2 ) ™( 2 ) ^(2 ) ™( 2 ) 

^2 1 

^(2) ^(2) n -t(2) -r^^) 

kt-^ ^2 "-"2, \ 

... _J"-i) ... 

Figure 2. A Gelfand-Tsetlin array for F = H 



•^1 



,(3) _^(3) 
,(4) ^(4) _ (4) 

„(5) ^(5) ^(5) ^(5) 



•''1 -^n-l -^ri •''ri-1 '^'l 

Figure 3. A Gelfand-Tsetlin array for F = M, n odd 



2.(2) 
^(3) ^ ^(3) 

-y <^ 2^ 

.(5) ^(5) _^(5) _^(5) 



■-''1 ■''fi-l -'n-l •''1 

p(") T,(") _™(") 

■-l -^n-l "^ri ■''1 

Figure 4. A Gelfand-Tsetlin array for F = M, n even 
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Let M E 7'n(F) be an invariant random matrix. The vector X{M) is a random 
variable with values in GTn = UAec„Gr„(A). We will show that the law of X(M) 
involves uniform probability measures on Gelfand-Tsetlin polytopes. 

Definition 3.2. For A in the Weyl chamber Cn, we let fj,x be the image of the 
uniform probability measure on GTn{\) by the map Pn-i '■ x G GTn{X) i— *■ S 

Cn-l- 

We observe from figures [T] to S] that Gelfand-Tsetlin polytopes can be defined 
recursively. Thus the uniform measure on GTn{X), denoted rnQT^(^\), satisfies the 
remarkable identity 



(6) rnGT„i\) ^ J rnGT„^iip) ti-\idP), 

which explains why we first focus on the measures fi\, X E Cn- The following lemma 
is proved at paragraph llO.il The matrix ri„(A) considered in this lemma is defined 
in 2.2. 

Lemma 3.3. Let A be in the Weyl chamber Cn and U € Un(V) be a Haar distributed 
random variable. Then the distribution of the radial part of the main minor of order 
n—1 ofUQ.n{\)U* is pL\. 

We will now describe the law of X{M) for every invariant random matrix M 
in Vn (IF) . It follows from lemma 12.41 that it is enough to describe it for M — 
Ufl„{X)U* , with U a Haar distributed random variable in Un(P) and A fixed in C„. 

Theorem 3.4. Let M = UVLn{X)U* , with U Haar distributed in ?7„(F) and A e 
Cn- Then X(M) is uniformly distributed on GTn{X) for F = K,C and is dis- 
tributed according to the image of the uniform measure on GT„(A) by the map 
{x'^i\--- ,x("-^),a;(")) e GT„(A) ^ {x'^^\ x^^\ ■ ■ ■ /or F = H. 

Proof. Identity ([6]) implies that it is enough to prove that for every integer k £ 
{1, • • • , n — 1} and every bounded measurable function / : Ck K, the conditional 
expectations satisfy 

E[/(x('=)(Af))|(7{X('^+i)(M),-- - ,X(")(M)}] =E[/(xW(M))|a{X('^+i)(M)}]. 

For V £ Uk+i{¥) we write VMV* instead of 

V 0\ (V* 
Ij \0 I 

where / is the identity matrix with appropriate dimension. Let us write the radial 
decomposition nk+iiM) = Ffife+i(X('=+i)(M))y*, with V £ C/fc+i(F). Let W 
be a random variable independent of M, Haar distributed in Uk+i{¥). We have 
WTTk+i{M)W* = nk+i{WMW*) andXW(l^MH/*) = XW(M), r = k+l,--- ,n, 
so 

(7rfe+i(Af),X('^+i)(M),... ,X(")(M)) 
has the same distribution as 

{wnk+i{x^''+^'> {M))w* , xC'+i) (M) , • • • , (M)) . 
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Then we have 
]E[/(X('=)(M))|cr{X('=^+i)(M), • • • , X(")(M)}] 

= E (TTk+i (M))) \a{X^''+'^ (M), • • • , (M)}] 

= E[/(xW(VP^r!fc+i(X('=+i)(M))VF*))|a{X('=+i)(M), • • • ,X^''\M)}] 

= E[/(xW(M))|a{X('=+i)(M)}]. □ 

Let us now give an explicit description of the measures /j-x, A e C„. We first 
introduce a function ci„, that we call asymptotic dimension. Recall that e is equal 

to 1 if n ^ 2N and otherwise. 

Definition 3.5. We define the function dn on Cn by 

dn{X)=Cn{X)-^Vn{X), X & Cn, 

where the functions Vn and Cn are given by : 
• when F = C, 

Vn{X)= n (^i-^.)' 
l<z<j'<n 

cn(A)= n 0-^)' 

l<z<j<n 
A. 5^ A, 



Vn{x)= n (^*-^^) n n 

l<z<j<n l<i<j<-n l<i<n 

Xi^Xj Xi^-Xj A,; 7^0 

Cn(A)= n (j'-*) n (2n + 2-j-z) J] (n+l-z), 



l<z<j<n l<2<j<n l<z<n 

Ai5^Aj Ai5^-Aj Ai^O 



• w/ien F : 



Vn{x)= n (^^-^^o n (^*+^^) n 
cn(A)= n 0'-^) n ("-i-o n 



2 

l<i<j<n l<i<j<n l<i<h 

Xi^Xj Xi^ — Aj A^^O 

When A is in the interior of the Wcyl chamber, then rf,i(A) is just, up to a 
constant, the product of the positive roots of C/n(F). We let c„ = c„(A) in this case. 
We have the following lemma. 

Lemma 3.6. Let X be in the interior ofCn- Then 

• when F = C, 

dn{X) = Cndet{Xj~ ) 

• when ¥ = 11, 

dn{X) = c„det{Xi^~ ) 
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when F = M, 



nxn- 



In particular, when F = C and A is in the interior of the Weyl chamber, dn{X) is 
just the Vandermonde polynomiaL The following lemma shows the importance of 
these fonctions for us. 

Lemma 3.7. For any X in the Weyl chamber Cn, the volume of GTn{X) is c?„(A). 
Proof. It is an immediate consequence of lemma 110.11 □ 

For A in the Weyl chamber, we let l\ be the Lebesgue measure on the convex set 
p„_i(G'T„(A)), where Pn-i is the projection introduced at definition 13.21 

Lemma 3.8. Let A be in the Weyl chamber. Then, 

• when F = M, C, 

• whenW^M, 

dn[X) 

Proof For x € GT„{X), the vector • • • when F = C,K and the vector 

{x^2)^x'^^\x^2)^... ^x^"~^'>) when F = M, belong the Gelfand-Tsetlin polytope 
GT„_i(x'"~^^), whose volume is equal to (i„_i(a;'"~^)) by lemma l3?7l This implies 
easily the lemma. □ 

We now give the density of fj,\ for two particular cases: when A is in the interior 
of the Weyl chamber and when A has only one strictly positive component. For the 
computations, we recall a generalised Cauchy-Binet identity (see for instance [M]). 
Let {E,B,m) be a measure space, and let (pi and V'j, 1 ^ < be measurable 
functions such that the (f'i'fpj^s are integrable. The generalised Cauchy Binet identity 
is 

(7) det f / (f)i{xyjj{x)dm{x)) = ^ / det [(l)i{xj)) det (iji{xj)) Yl dm{xk). 

Let us also recall the identity which gives interlacing conditions with the help of 
a determinant (see Warren 61J). Let x and y be two vectors in R" such that 
xi > • • • > a;„ and yi > ■ ■ ■ > y-n- Then 

(8) ^{xyy} = det(l{a;;>y^).)„xn- 

Proposition 3.9. Let A be in the Weyl chamber Cn- If X is in the interior of Cn, 
then the measure ^\ has a density f\ with respect to the Lebesgue measure on C„_i 
defined by : 

d^-lW)- 



when ¥ = C, fx{f3) = ^^^jj^^ix-^fi}. 



. u;/^e7^F = M, /a(/3) = %;^1{|A|>,|/3|}, 

• when F = H, /a(/3) = '^^'^^^^ det((Ai - /3j)l{A,>/3j})rixn, with the conven- 
tion /3„ = 0. 

If X ~ (6,0, - ■ ■ ,0), 6 £ M-I-, then the measure fi\ is equal to jl\ ® S^^^ , fix having 
a density gg with respect to the Lebesgue measure on M+ defined by : 
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. when F - C, ge{fi) = (n - 

. when F - M, ge{f3) = (n - 2)f^l[o,e](/3), 

. when ¥ = m, ge{(3) = (2n - 2)(2n - - /3)l[o.9] (/3). 

Proof. Lemma 13.81 gives immediately the densities fx and gg for F = C, M. For 
F = H and A in the interior of the Weyl chamber, this lemma implies that, for 

We get the announced formula using the identity ^ and the generalised Cauchy- 
Binet identity For F = H and A = (6*, 0, • • • , 0) we get from lemma EH] that, 
for P e R+, 



4. Rank one perturbation on 7',i(F) 

The next two sections are devoted to the LUE introduced in Definition 12.51 We 
will focus on the distribution of the eigenvalues. A random matrix of the LUE„^fc(F) 
can be written as ••• k ^^i^n^i^ where the M^'s are independent standard 

Gaussian variables in A^„(F) (cf. Lemma \'2.G\i . We will compute the distribution 
of its eigenvalues recursively on k. Thus, the study of an additive perturbation by 
the simplest Laguerre ensemble, i.e. the LUE^(F), is the first step, and we give in 
Theorem H31 the distribution of f^„(A) + Mn^M*, for A G C„. 

For A an element of C„ having only k nonzero components, the others being 
equal to zero, we will write r2„(Ai, • • • , Afc) instead of ri„(A). Let 9 e IR+ and U be 
a Haar distributed random variable in [/„(F). We first describe the distribution of 
the radial part of ri„(A) + Uiln{d)U* . We introduce the following sets. 

Definition 4.1. For A G C„, 6* G we define the set £(A, 9) by : 

• when F = C, 

n 

£{X,e) = {{p,x) e M" xGTn-.phX, 5] (A -K)=d,xe Gr„(/3)}, 

4=1 

• when F = H, 

£{X, 9) = {{/3, z, x) G R" X M" X GT„ : A, /? ^ z, 

^(A, + A - 2z,) ^9,xe GT„(/3)}, 

i=l 

• when F = R, n = 2r + 1, 

£:(A, 61) = {(/3, z, a;,s) G M!;_ x x GT„ x {0, 1}: X,(3hz, 

r 

^(A, + A - 2z,) = 0, a; G GT„(/3), s = z/ A, = 0}, 
1=1 
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• when F = M, n = 2r, 

E{\e) = {(/3,z,x) X X GTn ■.X,(3hz, max(|A,.|, |/3,.|) < 

r~l 

^(Afe +(3k- 2zk) + \Xr -(3r\=0,xe Gr„(/3)}. 
fe=l 

Each set £{X, 9) is either a convex set or an union of two convex sets. Thus we 
can define the Lebesgue measure on it. 

Definition 4.2. For X € C„, 9 € W^, we define v\^g as the image of the uniform 
probability measure on £{X,9) by the projection on the component fi, denoted by p. 

The following proposition is proved at paragraph ll0.2l 

Proposition 4.3. Let 9 G M^, A G C„ and U be a Haar distributed random vari- 
able in C/„(F). Then the radial part of the random matrix 51,i(A) + Ufln{9)U* is 
distributed according to the measure vx.e- 

Recall that a real random variable has a Gamma distribution with parameters 
(a, n) e M.*^ X N, if its density is equal to 

^-^e-"^{axr-H^4x). 

Recall also that we use the notation c = 1 when F = C, M and c = 2 when F = H. 

Lemma 4.4. Let M be a standard Gaussian variable in A^„(F). Then the radial 
part of Mill^AI* has only one nonzero component Q. It has a Gamma distribution 
with parameters (1, n) when F = C, (1, n— 1) when F = R, and (2, 2n) when F = H. 
Its density /e can be written, for some k > as 

fe{9)=kdn{9)e--' 

Proof. We make the simple remark that Affi^M* has the same eigenvalues as 
M*MVtl. If F = C or H, the matrix M* MVtl is equal to \V\^n\, where ^ is a 
standard Gaussian variable of F". This shows that MVl\M* has only one strictly 
positive eigenvalue, which has a Gamma distribution with parameters (l,n) for 
F = C and (2, 2n) for H. In the case when F = R, A/fJ^M* has only one strictly 
positive eigenvalue. The proof that it has a Gamma distribution with paramaters 
(l,n — 1) along the same line is not so immediate but remains quite elementary. 
Anyway, it will also follow from proposition 15.51 below. The last statement follows 
from the fact that dn{9) is equal to 

Qn—l 29^ Q2n — 1 

(9) 7 TT for F = C, — for F = M, — for F = H. □ 

^ ^ (n- 1)! ' (n- 2)! ' (2n - 1)! 

This fact, which will be useful for computations, is not a coincidence. Actu- 
ally it is a particular case of a more general result, proposition 15. 5[ the proof of 
which provides an interesting way to understand why the asymptotic dimension dn 
appears. 

Theorem 4.5. Let M be a standard Gaussian variable in A^„(F) and X be an 
element of the Weyl chamber Cn- Then the distribution of the radial part ofiln{X) + 
Mfl^^M*, that we denote v\, is the probability measure proportional to 

f yx.fi dn{e)e~'^''d9. 
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Proof. The matrix Affi^^M* is an invariant random matrix in 7'„(F). Thus lemmas 
12.41 and [4 . 41 ensure that M can be written Uiln{'d)U* , where U and Q are indepen- 
dent random variables with a Haar distribution on C/„(F) and the density Jq. It 
suffices to apply proposition 14.31 to see that i^a = S^^\,efe){0)d9. □ 

In the following section we will need an explicit formula for the density of the 
measure v\. We first deal with the measure v\.g. 

Lemma 4.6. For A G C„, 6 E R+, the volume of£{X,d) is equal to dn{X)dn{0). 
Proof. The lemma is immediately deduced from lemma fl 0.31 □ 

We denote by l\^g the Lebesgue measure on p{£{X, 9)), where p is the projection 
introduced at definition [ 



Lemma 4.7. Let A be in the Weyl chamber and 6 in M_|_. Then 
• when F = C, 



v\,e{dl3) = 



when F 



dniX)dn{9) 
dniP) 



hAdP), 



voliMx^mhAdfi). 



dn{X)dn{e) 

where M\fi{l3) is the projection, for [3 fixed, of £{\,0) on the component z when 
F = H or F = M with n even, and on the component (z, s) when F = M with n odd. 

Proof. By definition i>x.e is the image of the uniform measure on £{X, 9) by the pro- 
jection p. Thus, the normalisation follows from the lemma |4^ and the factor dn{P) 
appears when one integrates this uniform measure with respect to the component 

XEGTniP). □ 

We will see that \o\{M\_g{l3)) plays the role of an asymptotic multiplicity. It is 
replaced by one when F = C because this is the only field for which the irreducible 
decompositions described from propositions 19 . 21 to 19 . 51 are multiplicity free. Let us 
now describe the measure vx in some particular cases. 

Proposition 4.8. Let k be an integer smaller that n and A G R" be equal to 
(Ai,--- ,Afc,0, ••• ,0). When F = K, if n is even and k = h, we suppose that 
Ai > • • • > Afc_i > |Afc|. For every other case we suppose that Ai > • • • > Afc > 0. 

Then the measure v\ is equal to v\ ® 5q^^ (fe-i-i)Ari)^ where v\ has a density L\ 
with respect to the Lebesgue measure on RC^+i)^" defined by 
• when F = C, 

-l{/3>:A}e 



dnW 



Lxif3) = 2 



when F = I 

dnW 



dn{X) 

• when F = R 
Id„(/3) 



1 



-2E- = l(^i+ft-2z,)-/3fc+il{)=<„} 



{/9(k 



,>o}- 



2d„(A) 



n = 2r, k = r,r — 1, 

, l{A,/3t^,|A,|,|/3,|<z,_i}e~ 



(A.+ft-2z.)-|A,-,3,| 
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• when F = M, n ~ 2r, k < r 



2d„(A) 



l{/3;,+i>0}- 



Proof. Using the same notations as in the proof of theorem 14.51 we have that V}, — 
/r+ '^\,efei0)d0- Thus the proposition follows immediately from lemma H771 and 
the fact that feiO) ^ d„(6')e-* when F = C, fe{e) = 2"d„(6')e-2« when F = H, 
and feiO) = ^dn{9)e-'^ when F = R. □ 

Remark 4.9. We observe in lemma 14771 that the measures i^x^e are the same, in the 
cases ¥ — R, n ^ 2r + 1 and ¥ ~ M, n = r (see l8.2l for explanations). Moreover, for 
that two cases, the functions d„ are the same, up to a constant. Thus the measures 
i>x defined at theorem l4.5l are the same, up to the constant c. That's why we didn't 
write both cases in the previous proposition. 

5. Generalised Laguerre ensembles 

In this section we compute the law of the radial part of a matrix in LUE„^fc(F) 
by considering successive rank one perturbations, i.e. the random walk {Sk)k>o on 
P„(F) defined by 5*^ — ^^L^M^^I^Mi, where the M^'s are independent standard 
Gaussian variables in A1„(F). We compute the law of the radial part R/. of Sk by 
induction. The following proposition concerns the chain {Rk)k>o- In Figures O [H 
and [7] the black discs represent successive states of this chain for F = C,IHI and M. 
The white discs are intermediate points which indicate the interlacing conditions 
satisfied by the chain. 

Proposition 5.1. The process {Rk)k>a is a Markov chain whose transition prob- 
ability P{X, ) is equal to v\. When Rq — 0, Rk has k A h nonzero components. 

Proof. As in lemma [2741 we see that {Sk, Rk,' ■ ■ ,Ri) has the same law as 

{UflniRk)U*,Rk,--- ,Ri), 

when U E Un{¥) is a Haar distributed random variable independent of {Rk, ■ ■ ■ ,Ri). 
Then for every bounded measurable function / : 'Pn{¥) M, 

E{fiSk+i)\<j{Rk,--- ,Ri}) =nf{U^n{Rk)U* + Mk+inlMl+^)\a{Rk, - ■ ■ ,Ri}) 

= E{f{Un,,{Rk)U* + Mk+inl^M*k+,)W{Rk}). 

Thus {Rk)k>o is Markovian. The transition probability is given by theorem l4.5l and 
it is clear, for instance from lemma 14/71 that the last point is true. □ 



i?4 

R2 

Ri 



(ii) 



Ro-^ i 



Figure 5. Rank one perturbations on 'P^{C). 
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Figure 6. Rank one perturbations on 7^2 (H). 
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Figure 7. Rank one perturbations on 7^4 ( 



We have now gathered aU the ingredients needed to get the law of the eigenvalues 
of the matrices from the LUEn^ki^)- For A € M", the Vandermonde determinant is 

A„(A)= n (^»-^^)- 

l<i<j<n 

n when F C,H, n = [n/2] when F = K, 
H and flk is given by (H]). 



Recall that n = 
c = 2 when F = 



1 when F 



Theorem 5.2. Let M be a standard Gaussian variable in Al„^fe(F). Then the 
positive eigenvalues of MflkM* have a density fn_k with respect to the Lebesgue 
measure on W^^^ and there exists a constant C > such that for A G M"^'^, 



nAk 



(10) 



/n,fc(A) = Crf„(A)A-^^,(A)nA, 



(fc-fi)VO^-cA, 



Proof. Let us first prove it by induction on k when F = C, H. The random matrix 
MilkM* has the same law as the random variable 5^ introduced at the beginning 
of the section. The property is true for fc = 1 by lemma 14.41 Suppose that it is 
true for fc > 1. Let j — (71, • • • , jk/\n,0, ■ • • , 0) be a vector of such that 71 > 
• • • > Ik An > and M be a standard Gaussian variable in A^„_i(F). Proposition 
4.81 ensures that the strictly positive eigenvalues of fln{l) + MQ\M* have a density 



Lj with respect to the Lebesgue measure on R^'^C^+i), which proves the first point 
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and implies that, for A G M"^(fe+i), 
(11) /n,fc+i(A) = / /„,fc(7)L^(A)d7. 



+ 

Let us now distinguish the complex and quaternionic cases. When F = C, identity 
and the induction hypothesis imply that there exists a constant Ci such that 



nAk 



(12) /„.fc+i(A)=Cid„(A)e-^.^- / A,A„(7)TT7f""^''"l{A>,7}c'7- 

When k < n, the integral above is an homogeneous polynomial of degree ^k{k + 1), 
equal to zero when Xi = Xj , i ^ j , so it is proportional to Afc+i(A). This proves the 
property for k + 1 < n. The positive eigenvalues of MM* being the same as those 
of M*M, we get the proposition for /c > n as well. It implies that for some Ck > 0, 

„ nAk nA(fc+l) 

(13) / A,A„(7)n^i''"^"°l{»^7}rf7 = CfeA(,+i)A„(A) n Af+^-")^°. 



When F = H, we get that /n,fc+i(A) is proportional to 



kAn 



The generalised Cauchy Binet identity implies that 

kAn 
i=l 

det(7r'^^'~"^"°) det(l{,.>.^.} e-^(^-^^)) d7 



(fc A 71,)! 

det( / 7^-'+('=-«)-"l{,>,ae-^(^--)d7) 



where C2 is a constant. Using (fTS]) . this proves the property for k + 1. 

Let us now prove the proposition when F = R. By Remark 14.91 the odd real case 
is the same as the quaternionic case replacing n, k and c = 2 by h, k and c = 1. 
Thus, the property is true for the real odd case. If n is even, it is easier to use what 
we know about the odd case rather than proposition 14.81 to get the result. Let us 
consider the random matrix 



N = 



X 



X being a standard Gaussian variable in A^i .fc(M), independent of M . Then, the 
density of the strictly positive eigenvalues of NQkN* is fn+i.k- This random matrix 
has a law invariant for the adjoint action of Un+i (M) and its main minor of order n is 
MflkM*. Thus, using lemma[33 we get that for A G Rf''', /„,fc(A) is proportional 
to 

dnW 



SAfc dn+l{"f) 



/n+l,fc(7)l{7bA} d'l- 
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The integer n + 1 is odd, so we can replace fn+i,k in the previous identity by the 
formula (fTO|) . An easy computation achieves the proof. □ 

Let us notice that this theorem shows that the eigenvalues of a random matrix 
from the LUE(F) are distributed as some biorthogonal Laguerre ensembles studied 
by Borodin in |8]. Moreover it allows us to compute the density of the random 
matrix itself. Let e be equal to 1 if n ^ 2N and otherwise. 

Theorem 5.3. When k > n the distribution of a matrix of the LUEn^ki^) has a 
density 1{H) with respect to the Lehesgue measure dH on Vn{¥) proportional to 

n 

l[Xt"e'^'lR^{X,), forW^C, 
1=1 

1 " 

^ - n Ar-^e-^' , forW = H, 

1 " - 

— -— n Ar'^-e-^- , /or F = R, 

where A is the vector of eigenvalues of H when F = C, of positive eigenvalues of H 
when F = E,H. 

Proof. The function (i„ being proportional to the product of roots on the interior 
of the Weyl chamber, Weyl integral's formula (see Helgason [33 , Thm. 1.5.17) says 
that there exists a constant C > such that for every invariant measurable function 
/ : P„(F) ^ R+, we have 

/ f{H)dH^C [ d„(A)2/(A)dA, 

Jv„(¥) Jc„ 

where dH and d\ are the Lebesgue measure on Vn(^) and C„. Thus theorem 15.21 
implies that the density of a random matrix of the LUE„^fe(F) is proportional to 

We achieve the proof by replacing d„(A) by its value. □ 

For A in C„, let us consider a random matrix ri„(A) + X)i=i kMi^n{oii)M* ^ 
where the Mi's are independent standard Gaussian variables in A4„(F) and the 
ai's are some real numbers, or equivalently a random matrix f2n(A) + M^k{oi)M* ^ 
where M is a standard Gaussian variable in A^„_fc(F). When A = and F = C, 
it has a generalised Wishart distribution. One easy way to compute the law of 
its eigenvalues is to use the Harish Chandra formula (see for instance Wang [50]). 
But this method doesn't work for the other fields. Our method, which consists 
in computing the law of the eigenvalues by induction, provide a way to compute 
the law of the radial part of Jlra(A) + MVlk{ct)M* for any field F. Nevertheless, 
computations are not always easy for such a general matrix. Actually, in the case 
when A = and k < n, computations are much simpler using lemma 13.31 rather 
than this approach. To do this, we need the following theorem which goes back to 
Borel [5] (see Olshanski [5l], Pickrell [54]). 
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Theorem 5.4. Let {Un)n>i be a sequence of random variable such that Un is 
Haar distributed in J7Ar(F). Then the main minor of order n of \/NUn converges 
in distribution to a standard Gaussian variable in A1„(F), when N goes to +00. 

Proposition 5.5. Let k be an integer smaller than n, M be a standard Gaussian 
variable in Ain,k{^) and a € M'^ such that ai > ... > > 0. Then there is a 
constant C such that the positive eigenvalues of Mflkia)M* have a density gn,k 
with respect to the Lebesgue measure on R'j_ defined by 

9n,k{\) = C '^^^ det(e ''^)i<i,j<^^- 

dn{a) Yl.^ia, 

In particular, when k = \ and ai = \, this density is proportional to the function 

Proof. Let iV e N be an integer greater than n. We consider a Haar distributed 
random variable Un G Un{^)^ the random matrix Mjv = UN^N{ct)U'^ and its 
main minor of order n denoted by TT„(Mpf). Using lemma we obtain that the 
density of the k strictly positive eigenvalues of ■kn-i{Mn) is proportional to 

Iterating for the smaller minors and using the Cauchy Binet identity we obtain that 
the density of the strictly positive eigenvalues of 7r„(MAr) is proportional to 

rfn(A) (a,-A,-r(^-")-i . 

dN{a) ^ {c{N-n)-l)\ ''''>^^h<^,J<~k■ 

So the distribution of the strictly positive eigenvalues of NiiniMM) converges to a 
distribution with a density proportional to 

dn{X) 

——^k det(e Oi<,,<^- 

Theorem 15 .41 states that N-Kn{MM) converges in distribution to MVtn{a)M* , as N 
goes to infinity, which completes the proof. □ 

The joint eigenvalues density of the Laguerre unitary ensemble LUE(C) has been 
known for a long time [3D]. For the invariant ensembles LUE(F) with F = H or 
F = K, it seems to be new: none of them is associated to the Gaussian ensembles 
for the symmetry classes recalled in 12.41 We have already seen some specificities 
of these ensembles: for instance the support of a random matrix of the LUE„^fc(F) 
for the other fields than C is all the set of rank k matrices of 7^„(F) whereas 
in the complex case, this is the set of positive rank k Hermitian matrices. For 
instance, we know that if M — {Mt)t>o is a standard Brownian motion in A^„(C), 
then MtM^ and the process of its eigenvalues are Markovian. This follows from 
stochastic matrix calculus (see Bru [H]), or more conceptually from the fact that 
they are radial parts of the Brownian motion in the flat symmetric space associated 
to U{n,k)/U{n) x U{k) (see Forrester [M], Roesler [S^)- This is not the case in 
general: if (Mt) is for instance a standard Brownian motion in A^2(K), then neither 
Mt^2M^ nor the process of its eigenvalues (this is the same here !) is Markovian. It 
will be interesting to investigate these invariant ensembles which seem to be deeply 
different from the usual ones. 
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6. Interlaced determinantal processes 

Let E he a, Borel subset of M^. A counting measure ^ on E' is a measure such 
that £,{B) is an integer for aU bounded Borel set B of E. Let us consider a sequence 
{Tk)k>i of random variables with values in E and S = X^fceN^Tf If is almost 
surely a counting measure on E, we say that S is a point process on E. Let m be 
a measure on i?. A function pn on i?" such that 

n ^ 

j^l JBiX---xB„ 

for every disjoint bounded Borel sets • • • , Bn in i?, is called a n*'' correlation 
function. The measure m is called the reference measure. 

Definition 6.1. // there exists a function K : E x E ~f C such that for all n > 1, 

Pn {xi, ■ ■ ■ , Xji) = det[K [Xi , Xj))nxm 

for Xi, • • • ,Xn & E, then one says that the point process is determinantal and K is 
called the correlation kernel of the process. 

Let us give two classical examples of determinantal processes. For this we recall 
a classical way to show that a point process is determinantal and to obtain its 
correlation kernel (see Borodin [8J). Suppose that /x„ is a probability measure on 
having a density Un with respect to the measure m®" on i?" defined by 

(14) u„(Ai,--- , A„) = Cdet(V'i(Aj))„xndet((/)i(Aj))nx«, 

where C is a positive constant and the functions ipiS and 0i's are measurable 
functions such that ^-)i4>j is integrable for any i, j. We denote A = (Aij)i<ij<„ the 
matrix defined by 

Atj = / tl)i{x)4>j{x)m{dx). 



Then A is invertible and the proposition 2.2 of [8j claims that the image measure of 
the probability measure by the map (Ai, • • • , A^) ^ S"=i ^>^i ^ determinantal 
point process with correlation kernel defined by 

n 

(15) K{x,y) = Mx){A~^)^3<t^M, x,yeE. 
Suppose for example that £' = R, m is the Lebesgue measure and 

n 

(16) Un{\)=An{Xfl[w{X^), 

i=l 

where w is a positive integrable function on R such that J x^w{x) dx < +00 for 
any k. If (pi)i>o is a sequence of polynomials such that the piS have degree i and 
satisfy 



Pi{x)pj{x)w{x)dx = Sij, i,j e N, 
then A„(A) is proportional to det(pi_i(Aj)) and the correlation kernel is 

n 

(17) K{x,y) = 'Yp^{x)w{x)ipi{y)w{y)i , x,y £ R. 

i=l 
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This is an usual way to show that the point processes associated to the eigenvalues 
of the random matrices from the GUE or the LUE are determinantal. For these 
cases, the orthogonal polynomials which have to be considered to get a kernel of the 
form (jl7p are respectively the Hermite and the Laguerre ones. Let us now briefly 
describe the cases of the GUE(F) and the LUE(F) when F = K or F = H. 

We let e = 1 if F = H or F = R with n odd, and e = otherwise. Weyl 
integral's formula ([33], Thm. 1.5.17) implies that there exists a constant C such 
that the vector of the positive eigenvalues of a random matrix M from the GUE(F), 
F = H, R, has a density fgue defined on R" by 

n 

(18) /<,ne(A) = Cd„(A)2 J|e-3^aK+(A,). 

i=l 

Lemma [3.61 shows that the density fgue has the form ([14]) with h instead of n and 
for instance ipi{x) — 4>i{x) = a;^'~^"'"'^e~3:^ . Thus the associated point process is 
determinantal. Since the Hermite polynomials have only monomials of same parity, 
it shows that the correlation kernel is 

n 

Actually this situation corresponds to a classical one. It suffices to make the change 
of variable A'j = Af in (|18p to get the classical form ([T6]) with ■w{x) ~ a;"e~2^^ where 
a — ^ when F = H or F = R, n is odd and a = — i when F = R, n is even. The 
orthogonal polynomials to consider arc thus the Laguerre ones. 

For F = H or R, theorem [521 shows that the density of the positive eigenvalues 
of a random matrix from the LUE„_fc(F), for k > n, has the form (|14p with n 
instead of n and for instance tpii^) = 2;^*^^+^+'''^", 4>i{x) = a;*~^e~'^^. Thus, the 
associated point processes are determinantal and their correlation kernels are given 
by Nevertheless, it is important to notice that the orthogonal polynomials 

method can't be applied here. 

In the following, we will study more generally the determinantal aspect of the 
interlaced processes considered in the previous sections. Using the explicit formula 
that we got, we write their measures as a product of determinant and use the 
method Johansson [34] and Borodin et al. [7] to show that a large class of them are 
determinantal and to compute their correlation Kernels. 

6.1. "Triangular" interlaced processes. The first type of interlaced point pro- 
cess that we consider is the one associated to the eigenvalues of the main minors 
of an invariant random matrix in Vn (F) . In this case E — {I, ■ ■ ■ ,n}xR and the 
reference measure m is the product of the counting measure on {1, • • • , n} with the 
Lebesgue measure on R when F = C, on R4. when F = H and F = R. 

Definition 6.2. We say that an invariant random matrix M in 7^„(F) belongs to 
the class K, if the eigenvalues of AI for F = C. and the positive eigenvalues of M 
for F = R or ¥ — M., have a joint density with respect to the Lebesgue measure on 
R" proportional to 

d„(A) det('(/'j(Ai))sxn, 
where the 4'i 's are real continuous functions on R, equal to zero on R_ for F = R 
and F = H, and such that for all fc € N, the function x i— > x*''4)i{x) is integrable on 
R. 
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Many invariant ensembles belong to the class /C, especially the random matrices 
from the GUE(F) and the LUE(F). 

Theorem 6.3. Let M be an invariant random matrix in P„(F), which belongs to 
the class K-. Let us consider the random vector X ~ X(M) and the associated point 
process ^ on E defined by 

n k n k 

S = S^^ ^{k)-^when F = C, H, and S = 6^j^ ^-^(k) ^^when F = R. 

k=l 1=1 ' fc=l i=l 

Then 

(i) The point process S is determinantal. 

(m) The correlation kernel ofE. is, for {r,x), {s,y) € E, 

K{{r,x),{s,y)) = " [c{s - r) - 1)! ^{^>'--^>"} 

k=l •' ^^fe 1=1 

i^k 

where ■ip;_kix) = (^c{n-r)-i)<. (^ ~ a^)''^"'''^' Vfc(^) '^^^ if r < n, ^"_ki^) = 

ipk{x) and = / d„(z) HLi V'i(^j) c^-^i 

We observe that (X(^^(M), • • • ,X(")(Af)) when M is an invariant random ma- 
trix in ni(H), has the same law as {X^^\N) , X^^'^ [N) , ■ ■ ■ , (iV)) when N 
is an invariant random matrix in 7^271+1 (R), provided that X^"'\M) has the same 
law as X'^^"+^)(iV). So the quaternionic case is deduced from the real odd one in 
the previous theorem (see 18.21) . 

Corollary 6.4. Under the hypothesis of the previous theorem, suppose that we can 
write dn{X) = det(xi(Aj))sxri, where {xk)k>i is a sequence of real functions on R 
such that the Xi'^Pj o'^e integrable on M and J^Xi{x)4'jix)dx = Sij. Then 

K{{r,x),{s,y)) - - l{s>r, y>x} + 2^ C-fc(^) ^^c(n-s) 

If the radial part of M is deterministic and equal to A in the interior of the Weyl 
chamber, the theorem and its corollary remain true up to slight modifications, 
replacing "01 (■^) d-z by the Dirac measure (dz) for F = C and by S\\. \ (dz) for F = 
R, in the kernel and the counting measure on {1, • • • ,n} in the reference measure 
by the counting measure on{l,-- - ,n— 1}. Let us describe some applications before 
making the proofs of the theorem and its corollary. Recall that we let e be equal 
to 1 if ri ^ 2N and otherwise. 

The Gaussian case: GUE(F). As we have seen a standard Gaussian variable 
M in Vni^) satisfies the hypothesis of the theorem with ilji{x) — x'^^^e"^^ when 
F = C and '4>i{x) = jj^'-z+eg-^a: i^^^pj otherwise. Besides, the hypothesis of the 
corollary are satisfied if we let Xi — ^i-i when F = C, Xi = /i2i-2+e when F = R 

and Xi — ^2j-i when F = H, where {hi)i>o is the sequence of normalized Hermite 

12 ~ 

polynomials for the weight e~2^ ^ such that hi has degree i. 

In the case of the GUE(C), the corollary was obtained by Johansson and Norden- 
stam [35], and Okounkov and Reshetikhin [49]. The following proposition, which 
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provides the correlation kernel for the minor process associated to a matrix from 
the GUEoo(IR), has been announced in [16j. Forrester and Nordenstam posted a 
proof on arxiv a few weeks later in [25j . 

Proposition 6.5. Let M he a standard Gaussian variable in Poo(ffi.). We consider 
the radial part X'^^'> e R*^ of the main minor of order k of M . Then the point 
process ix**"'!) determinantal on N* x R+ with correlation kernel 

i?((r, x), (s, y)) = -j^^iv - xr~^~\yy,] 

+ l^i=l ((s-2i)!)i/2 'ls~2i(y)nr-2i(X)e 2 

hs-2.{y) r+oo 1^2 

-t- Z^i=f+l ((s_2i)!V^)i/2 (2i-r-l)! ^ 

Proof. Let n be an odd integer and M be a standard Gaussian variable in 7'„(M). 
The matrix M belongs to the class /C with ipi ~ /i2i-i, i = 1, • • • , n. The functions 
Xi = ^2i-i, i = 1, • • • , 7^, satisfy the hypothesis of corollarv l6.4l So the point process 



X]fc=i X]i=i ^(fc ix**"'!) determinantal on N* x ]R_|_ and its correlation kernel K is 
equal to 



1 " 



(r - s - 1) 

poo (£-£)" -'^-1 , / N _1,2 



where ^fcC?", a;) = („_r_i)! ^2fc-i(^:)e 2^ dz. Let us consider 

1 2 d" 12 

i7„(x) = (-l)"e2- ^e-2- . 

We recall that /i„ = (-„|^-)i/2 ^nd ft,^ = \pnhn^\. Letting i = n — fc + 1, we get 
that 

Integrating by part we get that when i > f + 1 , 



1 /"^ (z — x) 



1 ,2 



and when i < r. 



^kir, x) 



(r - 2iy. 



1/2 



/ir-2i(a;)e 



.{n-2iy.. 

which proves the proposition. □ 

The Laguerre case: LUE(F). A random matrix from the LUE„_fc(F) satisfies for 
k > n the hypothesis of theorem 16.31 with -0^(0;) = x*~^+'^~"e~'^^lK^ (x). Those of 
the coroUarv 16.41 are satisfied only when F = C with ipi — Xi — Li, where {Li)i>Q 
is the sequence of normalized Laguerre polynomials for the weight a;'^~"e^^, such 
that Li has degree i. 

Let us now prove theorem l6.3l The main point of its proof is the following lemma 
which is an application of [7j. For f,g:M.xM.-^ M+, /i : K. ^ Rj^ and x,y eM., we 
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write, when it's meaningful, 

(19) if * g)(x,y) ^ J^f{x,z)g{z,y)dz, {f * h){x) = f{x, z)h{z) dz, 



Lemma 6.6. Let M be an invariant random matrix as in theorem ] 6. 3\ and S the 
associated point process. We suppose that the support of the functions V'i 's and (pi 's 
are included in an interval ]a,b[. Then the correlation kernel ofE, is defined by 

• when F = C, 

n s 

K{{r, xl {s, y)) = -c^^^-^^ {x, y) + J2 Vr-k{^) («' v)^ 

k=l 1 = 1 

• when F = R, 

n s 

K{{r, x), {s, y)) = + ^ rr-ki^)Y.(B-')ki^^'-''+'\0, y), 

k=l 1=1 

where (f){x,y) = l[x,oc){y)j ^'^'^ ^ '"^'^ B are invertible matrices defined by Aij — 
^^^(^a), i, j = 1, - •• ,n, and B,j = 0("-2»+i) * Vj(0), i,j = 1, - • • ,n. 

Proof Let us consider A = (A^i),-- - ,A(")), where A^ = CT^(A:W(Af)), when 
F = C and A^'') = ari\X'-''\M)\), when F = M, where the cr^'s are independent 
random permutations of the coordinates, uniformly distributed and independent 
from M. The reason why we introduce these permutations is that we have to work 
with symmetric densities. Since the random matrix M is invariant, theorem 13.41 
lemma [X71 and identity ^ imply that the density of (A*^^^ , ■ • ■ , A^"^) is proportional 
to the function / defined by : 

• when F = C, with the convention that xi^ — a, 

n 

• • • = det(^,(xi")))„xn n (i{.r>.r->}; 



r X r ' 



• when F = R, with the convention that Xr = 0, 

n 

f{x^'\ ■ ■ ■ = det(V',(x|")))sx^ n (l{."-)>.<'--'})fx.- 

r = l ^ 



We consider a sequence {An)n of discrete random variables such that A^f belongs 
to jjGTn^-L andP(AAr = (x'^',- • • is proportional to /(x^i),- ■ • ,a;(")). Then 

lemma 3.4 in [7j, slightly modified for F = R (see ^25j for details), implies that the 
associated point process is determinantal with a correlation kernel Kj^ obtained 
from K replacing the Lebesgue measure on R in identities (|19p by the counting 
measure on -^Z. We get the lemma letting N goes to infinity. □ 



Proof of theorem 16.31 We write the proof for F = R. We use the lemma l6Jl 
and its notations. We have, for r > 1, 
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Thus, (/.(^-2'+i)(0,y) = ^</,(«-2'+i)(0,y), / = 1,. . . ,n, and 

1=1 ^ 1=1 

Let us denote sik{B) the matrix obtained from B by suppressing the hne and 
the fc*'' column. We have 

(_l)k+l 

= VT7^det(sifc(B))s_ixs-i. 
det(i5) 

Thus 

^(i?-i)fe,<^("-2'+i) (0, J/) = ^ det(sa.(S))s-ixn-i0("-''+^) (0, 



E ^777^ / det(0("-2^+i) (0, z,)) (0, y) [] V', (^.O^^, 
^ det(i^) j-^fc ^^j^ 

1 /■ " 
-j^^ det(,^("-2»+i)(o^ z,))sxs n ' letting Zk = y. 



Moreover, if Vn is the function introduced at definition 13. 5i we have 



det(</>("-2^+i)(0,z,)),,xf. = det(-^— l{,,>o})^xft = Vn{z)l[ 

[n zt). [n II). 

which achieves the proof for F = M. We get the theorem letting a and h go to — oo 
and +0O. The case F = C is quite similar. We deduce the quaternionic case from 
the real odd one. □ 

Proof of corollary 16.41 The corollary is deduced from the theorem using 
the identities 

n „ 

det(xi(2;j))ftxn W dzj = det( / Xi{z)'^]{z) dz)^^^ = 1 

p n 

/ det{xiizj))nxn TT i}j{zj)dzj = det(ajj)ftxn = Xkiv), 

where aij = Sij, j and a^fc = Xiiu)^ i = 1, • • • , n. □ 

6.2. "Rectangular" interlaced processes. In section 5, considering successive 
rank one perturbations, we have constructed Markov processes which have a re- 
markable property: two successive states satisfy some interlacing conditions. Thus 
we got interlaced random configurations on N x M. More precisely, let {Mk)k>i 
be a sequence of independent standard Gaussian variables in A^„(F). For A in 
the interior of the Weyl chamber, we consider the process {R'^'"^)k>i, where 
is the radial part of il„(A) + J2^=i ^'^i^n^i ^ ^^'^ the associated point process 
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E!> — X^fcLi ^fc • Since interlacing conditions and function dn can be writ- 

ten as a determinant for F = C, F = H or F = R with n odd, our proposition 15.11 
shows that the hypothesis of proposition 2.13 in [34] are satisfied in these cases and 
that the point process Sa is determinantal. In the even real case, we don't know if 
this remains true. Thus we have the following proposition. 

Proposition 6.7. Let ¥ ^ C, ¥ = M or ¥ = R with n odd. Let {M,),>i be a 
sequence of independent standard Gaussian variable in Vn(¥) and A e R" such 
that Ai > ••• > An. Let us consider the point process Sa = X^fcLi '^fe flC"' ' where 

R^^'^ is the z*'* positive eigenvalue o/r2„(A) + X]i=i MiQ.\M* . 
Then, 

(i) the point process is determinantal on {1, ■ ■ ■ , m} x R+. 

(ii) The correlation kernel of is 

h 

K^{{r,x),{s,y)) = -cj.^'-^^ + ^ cl>("^~-U i^{x,t){A-%^('\X„y), 

where (j){x,y) = ly>xe-(^-''\ i'ixj) = x^'^ when¥ = C, (j){x,y) = e-'=(=^+f)(e2'=(^^2')- 
1), ipi^i'^) = when F = H, R and A is an invertible matrix defined by 

A,, -0('»)*V(A^,J)■ 
Part 2. Orbit measures 

7. Approximation of orbit measures 

7.1. Introduction. Let K he a. compact connected Lie group with Lie algebra i. 
We equip t with an Ad(_ftr)-invariant inner product. This allows us to identify t and 
its dual t* . The group K acts on t by the adjoint action Ad and on t* by duality 
by the coadjoint action. By definition, the coadjoint orbit through A G 6* is the set 

C(A) = {Ad{k)X,ke K}. 

The (normalized) orbit measure is the image on 0{X) of the normalized Haar mea- 
sure mK on K, i.e. the distribution of Ad(U)X where J7 is a random variable with 
law niK- Computations for invariant ensembles of random matrix theory rest on 
a detailed analysis of either the sum (convolution) of orbit measures on 0(A) and 
0{^), where A, ^ G t*, or their projection p on the dual Lie algebra of a subgroup 
H. Let us recall two basic facts of Kirillov's orbit method ([41], [42], p.xix). In his 
famous "User's guide" the third and fifth rules are the following (we denote by V\ 
the irreducible module associated to A): 

Rule 3: If what you want is to describe the spectrum of Res^V\ then what you 
have to do is to take the projection p{0{X)) and split into Ad{H) orbits. 

Rule 5: If what you want is to describe the spectrum of the tensor product of 
Vx (g) Vfj, then what you have to do is to take the arithmetic sum 0{X) + 0{ij) and 
split into Ad{K) orbits. 

Our method is to use these two rules, but in the reverse order: we interchange 
" what you want" and " what you have to do" . First we prove a version of a theorem 
of Heckman which will allow us to give an effective way to compute the measures 
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on dominant weights defined with the help of the so called branching rules. Then 
we obtain the convolution or the projection of orbit measures using these rules. 

7.2. Characters. Let be a connected compact Lie group with Lie algebra t 
and complexified Lie algebra 6c- By compactness, without loss of generality, we 
can suppose that K is contained in a unitary group, and then the adjoint and 
the coadjoint actions are given by Ad{k)x = kxk*,k G K,x G t or t*. We choose 
a maximal torus T oi K and we denote by t its Lie algebra. We consider the 
roots system i? = {a G t* : 3X e «c \ {0}, V7J e t, [H,X] = ia{H)X}, the 
coroots ha = 2a/ {a, a), a G R. We choose the set E of simple roots of R. We 
introduce the corresponding set i?"*" of positive roots and the (closed) Weyl chamber 
C = {A e t* : (A, a) > for all a € S}. The set of weight is P = {A S t* : {h^, A) G 
Z, for all a E R} and the set of dominant weights is P+ = P DC. We denote by 
W the Weyl group. 

For A g P+, we denote by V\ the irreducible t- module with highest weight A 
and dim(A) the dimension of V\. Its character xx is the function on t defined by, 

where rn(/x. A) is the multiplicity of the weight /i in the t-module V\. Notice that we 
use representations of the Lie algebra rather than representations of the compact 
group. We denote P — ■^J2aGR+ '^^ ^^^^ '^^ positive roots. The dimension 
of the module V\ is given by xa(0). Recall the Weyl dimension formula (see Knapp 
[44], Thm V.5.84): 

and the Weyl character formula for the Lie algebra of a compact Lie group (see 
Knapp 44J, Thm. V.5.77): 



Proposition 7.1 (Weyl character formula). The character x\ is equal to 
Xa(C) 



j:^^^detiw)e^(^(^+pyO 



E»ewdet(«;)e*<-W'0 

In this formula, the denominator is also equal to the product na6_R+ (^^^"'^^ ~ 
e-i("^C)). When K — Un{C) and A have integer coordinates, the characters are the 
classical Schur functions (see for instance 27 ). 

Let us recall some properties of invariant probability measures on the adjoint 
orbits of the group K. Let, for z g t0 it, A € t*, 

Hz)= Yi {a,z),d{\)= {a,X)/{a,p). 

The quantity d{X) can be interpreted as the Liouvillc measure of the adjoint orbit 
©(A) or as an asymptotic dimension. For A € t*, we introduce the function $a on 
t such that $a(C) = ^xiKk*) for aU C G fc e K, and such that when ( e t, 

^ ^ E^gw-det(^)e-<-^.0 

h{iC)d{X) 



ORBIT MEASURES AND INTELACED PROCESSES 



33 



We recall the Harish Chandra formula (see Helgason [33], Thm II. 5. 35). In different 
contexts it is also known as the Kirillov formula for compact groups or the Iztkinson- 
Zuber formula. Recall that ttik is the normalized Haar measure on K. 

Proposition 7.2. For X e t* , C e t 

(21) / e*<'=^'=*'^>mK(&) = $A(C). 

JK 

This shows that $a(C) is a continuous function of (A, C) and <I'a(0) = 1. 

7.3. A version of Heckman's Theorem. We consider a connected compact sub- 
group H oi K with Lie algebra f). After maybe a conjugation, we can choose a 
maximal torus S oi H included in T (see for instance Knapp [44]). We denote 
its Lie algebra by s. The objects previously associated to K are defined in the 
same way for H. In that case, we add an exponent or a subscript H to them. For 
we denote by m^{/3) the multiplicity of the irreducible [)— module 
with highest weight (3 in the decomposition into irreducible components of the 
t— module V\ considered as an f}— module. Rules giving the value of the multiplic- 
ities are called branching rules. We have the following decomposition 

(22) Fa = ©^gp+m^(/3)l//, 

where V\ is considered as an [}— module and is an irreducible ()— module with 
highest weight f3. This is equivalent to say that is the unique function from 
to N satisfying the following identity: for all ( G s, 

(23) xa(c)= E ^mx^io- 

For a: G t*, let tth{x) be the orthogonal projection of x on t)*. The intersection 
between the orbit of an element x e under the coadjoint action of K and the 
Weyl chamber C contains a single point that we call the radial part of x and denote 
by r{x). The same holds for H and we denote by rnix) the radial part of x G f)* in 
the Weyl chamber Ch for the coadjoint action of H. We choose a sequence e„ > 
which converges to as n — > oo. The following theorem is a variant of theorem 6.4 
in Heckman [31]. We give a direct proof. 

Theorem 7.3. Let A be in the Weyl chamber C and (A„)„>i be a sequence of 
elements in P^ such that £„A„ converges to X as n tends to +oo. Then 
(i) the sequence {fJ.n)n>o of probability measures onCn defined by 

converges to a probability measure fi which satisfies, for C € \), 

(24) / $^(C)Mrf/3) = 'i>A(C), 

JCh 

(a) /i is the law of r ni"^ h{U XU*)) , where U is distributed according to wik- 
Proof. Let ( e 5. We have 

XA„(enC) ^ TT i(a,e„C) 

- '±'e„A„+e„p(.C,j _[_[ 



XA„(0) 11 g^(a,s„C> _ ^~i{»,e^O 
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On the other hand, 



XA„(£nC) _ ^p X^isnO m^'(/3)x^(0) 
XA„(0) /-^ x^(0) XX AO) 



£nC) 



Therefore 



Hm / $^+,„^^(C)A*n(d/3)-<i>A(C). 



The support of /i„ is contained in the convex huU of the orbit of e„A„ by the Weyl 
group. This imphes that aU the measures /i„ are contained in a same compact set. 
Uniform continuity on compact sets of the function $ ensures that 

(25) hm / <i>^(C)A^„(d/3) = $A(C). 

Let us consider the image 7„ of the product measure mn ® ^J-n by the function 
(u,/3) G H X Ch u(3u* € I)*. The previous convergence and Harish-Chandra's 
formula apphed to H give that 

hm / e^<^'^>7„(da:) = $a(C)- 



By invariance of the Haar measure on H by multiphcation, this remains true for 
every G t), which proves that the sequence of measures {'jn)n>o converges and 
consequently so does the sequence {pn)n>o- We denote by /x the limit measure. 
The convergence p5l) shows that it satisfies the following identity, for ( G i), 

$^(C)Mrf/3) = <i>A(C), 

which proves the first point of the theorem. Applying the Harish- Chandra formula 
to K and H we get 

g*("Au*,c)^^(^y) ^ f e'<'^"("^"*)'^>mK(dM) 

K Jk 

[ e'<"'3"*''^V(rf/3)mi/(rfM). 

H Jch 

which gives the second point of the theorem. □ 

In the case when H — T, the limit measure n is equal to d{\)~^D\ where 
Dx is the Duistermaat-Heckman measure associated to A. The tensor product 
of irreducible representations being a particular restriction of representation, the 
theorem has the following corollary, which is due to Dooley et al. [TO] . 

Corollary 7.4. Let A and 7 be in C. Let (A„)„>i and (7n)n>i be two sequences 
of elements in such that Sn^n and en'Jn respectively converge to A and 7, as n 
tends to +00. Let us define the sequence (t'n)n>o of probability measures on C by 

dmi(A„)dim(7„) 
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where M\^,^^[f3) is the multiplicity of the highest weight (3 in the decomposition 
into irreducible components of ® . Then the sequence {vn)n>o converges to 
the law of the radial part of X + U^U* , where U is distributed according to vtlk- 

Proof. Let Vx^ and V^^ be irreducible t-modules with respective highest weight 
A„ and 7„. Let us consider the compact group K x K. Then (8) V^^ is an 
irreducible (t x t)— module with highest weight (A„,7„). Applying theorem 17.31 
to the compact group K x K and the subgroup H = {{k,k),k € K}, we get 
that the associated sequence {i'n)n>i converges, when n goes to +oo, to the law 
of rH{'!TH{Ad(W){X,'j))), W being distributed according to the normalized Haar 
measure on K x K, i.e. W = {U,V), where U and V are independent random 
variables with distribution mx- The facts that TrH{Ad{W){X,^)) = UXU* + V'yV* 
and rniUXU* + V-yV*) = rH{X + U*V'yV*U) complete the proof of the corollary. 

□ 

8. Orbit measures and invariant random matrices 

8.1. In this section, we apply theorem 17.31 and its corollary to invariant random 
matrices in 7'„(F). For F = C,]HI,R the group J7„(F) defined in section 2 is one of 
the classical compact groups, namely, the unitary, the symplectic and the special 
orthogonal group. Its root system is of type An-i when F = C, C„ when F = H, 
Br when F = R with n = 2r + 1, and Dr when F = M with n = 2r. The Lie algebra 
il„(F) of C/„(F) is equal to iVn{V). 

Let us consider the set t„ = {i fln{x) : x E K"}. It is the Lie algebra of a maximal 
torus of C/„(F). We define the linear forms : t„ ^ M, by €k{i r2„(a;)) = Xk, x G M", 
k = 1, ■ ■ ■ ,h. We equip U„(F) with the scalar product {x, y) = Tr{xy*) for F = C 
and {x,y) = ^Tr{xy*) for F = H,R. For each group [/„(F), we choose the following 
set S of simple roots : 

• when F = C, S = {e; — Ci+i, i — I, - ■ ■ , rt — 1}, 

• when F = H, E = {2e„, - Ej+i, i = 1, • • • ,71 - 1}, 

• when F = R and n — 2r + 1, S = {e^, £i — e^+i, * = 1, • ' ' i ~ 1}: 

• when F = R and n — 2r, {cr-i + Cr, f-i — Cj+i, i = I, ■ ■ ■ ,r ~ 1}. 

If we identify R" and t„ by the map x E R" 1— > iri„(x) E t„, and t„ with t* 
by the scalar product, we get that x E R" is identifiable with iil.n{x) E t„ or 
S"=i ^j^i S t*. Up to these identifications, the Weyl chamber corresponding to 
the chosen simple roots is the set C„ defined in section 2, and the radial part of 
the matrix Ufln{x)U* is x, considering either the definition of section 2 or the one 
of section 7. An integral point in Cn is an element with entries in Z. Although we 
will not use this fact, one may notice that only integral dominant weights occur 
in the representation of the group C/„ (F) . When K = Un (F) , the corollary 17.41 is 
equivalent to the following theorem. 

Theorem 8.1. Let X and f3 be two elements in the Weyl chamber C„ and an 
associated sequence of measures {i'k)k>i chosen as in corollary \7.4\ Then {h'k)k>i 
converges to the law of the radial part of r2n(A) + Ufln{P)U* where U is a Haar 
distributed random variable in J7„(F). 

We consider the subgroup 7? {[/ e t/„(F) : Um = Uni = Sin,i = 1, • • ■ ,n} 
and its Lie algebra {M € il„(F) : Mi„ = Mni = 0, i = 1, • • • , n}. They are trivially 
identifiable with C/„_i(F) and il„_i(F). The orthogonal projection of a matrix M 
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of iln(F) on this last subspace is equal, up to some zeros, to the main minor of order 
71 — 1 of M . Thus, for the group J7n(F) and the subgroup iJ, theorem 17.31 gives: 

Theorem 8.2. Let \ he in the Weyl chamber Cn- Let us consider M = Ufln{X)U* , 
where U is a Haar distributed random variable in Un (F) and an associated sequence 
of measures {nk)k>i on Cn-i as in Theorem \ 7.3\ Then {p,k)k>i converges to the 
law of the radial part of the main minor of order n — 1 of M . 

8.2. Relation between quaternionic and real odd case. We have observed in 
the previous sections that on the one hand the rank one perturbations are the same 
for F = R and n = 2r + 1 as for F = EI and n = r, and on the other hand that the 
law of the radial part of the main minor of order n — 1 of Ufln{X)U* , with U Haar 
distributed in C/„(IHI), is the same as the law of the radial part of the main minor 
of order 2n — 1 of Vil.2n+i{^)V* , with V Haar distributed in J72n+i(R)- It is not a 
coincidence: identity p4)) shows that the convolution of invariant orbit measures or 
the projection of invariant measure depend only on the Weyl group of the groups 
and subgroups considered. At the price of some redundancy, we have chosen to 
state explicitely our results in both cases for the convenience of the reading. 

9. Tensor product and restriction multiplicities 

We want to compute the law of the sum or of the minors of invariant random 
matrices. By theorems 18.11 and 18.21 it suffices to have a precise description of some 
appropriate tensor product and restriction multiplicities. In group representation, 
these computations are a fundamental issue which have been studied for a long 
time. Recently the discovery of quantum group provided a new understanding of 
them. 

The rank one perturbations that we introduce in section 3 are related to the 
tensor products Va <X' V^7, where A and 7 are dominant weights, 7 being propor- 
tional to ei . Using the theory of crystal graphs of Kashiwara, we obtain in section 
9.1, explicit description of these decompositions. Our results are surely not new 
and they are contained, or maybe hidden, in more general ones (see for instance 
Berenstein and Zelevinski[3], Nakashima [48]) but our descriptions present some 
advantages: they are quite simple and make interlacing conditions arise, which can 
be described, in the spirit of Fulmek and Krattenthaler |26| for instance, in term of 
non intersecting paths. 

In section 9.2, we recall the classical restriction multiplicities that we need for 
the computation of the law of the main minors. 

9.1. Tensor product multiplicities and crystal graphs. Let us recall some 
standard notations for crystal graphs (see, e.g, Kashiwara [36j ) . As in the previous 
section we consider a compact connected Lie group K and its Lie algebra t. Recall 
that the crystal graphs of the t— modules are oriented coloured graphs with colours 

i £ I. An arrow a ^ b means that fi{a) — b and ei{b) = a where and fi are the 
crystal graph operators. We denote A^, i = 1, . . .n, the dual basis of the coroots. 
For a J— module V and its crystal graph B, the weight of a vertex b G B is defined 
by wt{b) = Y^iiViiP) - £,(5))Ai, where ipi{b) = max{n > : /f (6) G B} and 
£^(6) = max{n > : ef (5) € S}, i G I. For each dominant weight A we denote by 
B{X) the crystal graph of the irreducible 6— module V\ with highest weight A and 
by u\ the highest weight vertex. We recall the proposition 4.2 of [36] . 
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Proposition 9.1. Let A and ^ be two dominant weights and B{fj,) the crystal graph 
of . Then 

where the sum ranges over b G such that £i{b) < (ft.,;, A) (or equivalently 

£i{u\ ®b) — 0) for every i E I . 

We now consider K = C/,i(F) and we describe the tensor products V\ ® Vaei 
that we are interested in. For this we use the description of the crystal graphs for 
classical Lie algebras given by Kashiwara and Nakashima in [37]. In the following, 
we write x indifferently for (xi, • • • , Xn) G K" and ^i^i- Notice that ei is the 

highest weight of the standard representation. 

9.1.1. Tensor product of representations for the type A„^i. This case is classical 
and known as Pieri's formula (see Fulton 27J). But it will help the reader to first 
see the method we use in this simple example. In the type An-i, the simple coroots 
are hi — ei — e^+i, 1 < i < n — I. The crystal graph of V^-^ is, see [36], 

S(ei):1^2^..."-^'n. 

Here the weight oi i is ei, i = I, ■ ■ ■ ,n. We use the usual order on {1, • • • ,n}. Let 
m be an integer. Theorem 3.4.2 of |37| claims in particular that 

B{mei) = {6„ ® • • • ® &i G B(ei)^™ : b^+i > bk}. 

Let A be a dominant weight. Let us describe the decomposition of the tensor product 
Vx(^Vmei ■ In proposition lQ.ll the sum ranges over all elements 6m (E"- • -(^bi G B{mei) 
such that, for 1 < i < n, £i{u\ ^ bm ^ ■ ■ ■ ^ bi) = 0, which is equivalent to say that 
Si{bk) < {hi, A + wt{bk+i) + ■ • • + wt{bm)) for 1 < fc < m. When b G i?(ei), either 
b = i + 1 and £^(6) = 1 = —{hi, wt{b)), or £i{b) = < {hi, wt{b)). Thus we have 

(26) e,{b) < {h,,\)^0< {h„X + wt{b)). 

So, in the considered decomposition, the sum ranges over all elements 6m • • • fX" 
6i G B{€i)®"^ satisfying the following conditions for every k G {I,-- - ,m},i G 
{1, • • • ,n}, 

(17) / ^'''^^ - 

^ ' \ 0< {h^,X + wt{b„^) + --- + wt{bk)). 

We draw on figure [8| the functions 

k i-> ^i(fc) = (ei, A + wt{bm) H h wt{bm~k+i))- 

At each fc, one and only one of the functions fJ-i, - ■■ , /in increases by one unit. 
Moreover the curve cannot increase if the (z + 1)*'' has not because 6™ • • • (X) 6i 
is an element of B{mei). The curves cannot cross each other since < {hi,X + 
wt{bm) + ■ ■ ■ + wt{bk))- Therefore we see that the map 6™ ® • • • ® 6i i— s- /? g Z", with 
(3i = {ei, A + wt{bm) + • • • + wtibi)), i = 1, • • • , n, is a bijection from {6 G B{mei) : 
b satisfies conditions (|27)) } to {/3 G Z" : /3 ^ A, J2iif^i ~ ^i) — ™}- we get the 
Pieri's formula (notice that the multiplicity are equal to one): 

Proposition 9.2. Let A, 7 G Z" such that Ai > • • • > A„ and 7 = (m, 0, • • • ,0), 
m G N. Then 

Vx(g)V^= ®pV,3 

where the sum is over the integral dominant weights such that (3 ^ X, and m — 

Er=i(A-A.)- 
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Figure 8. Irreducible decomposition of Vx ® Knei for the type A2 

9.1.2. Tensor product of representations for the type C„. The siraple coroots are 
now hi = ei — fj+i, I < i < n — I, hn ~ Cn, and the crystal graph of Ve^ is 

/ \ -, 1 n — 1 n _ n— 1 1 q- 

i3(eij - n ^ n •••-^1. 

Here i and i have respective weight and — e^. We define the order < on -B(ei) by 
I < ■ ■ ■ <n <n < ■ ■ ■ <T. By theorem 4.5.1 of [37], if to e N, 

B(mei) = {6„ ® • • • ® 6i e B(ei)^" : bk+i > bk}. 

Let A be a dominant weight. As above is it easy to see that equivalence (|26|) holds. 
Therefore, by proposition 19. 1[ the sum ranges over all elements 6m • • • <X) G 
i3(ei)®™ satisfying the following conditions for 1 < fc < m, 1 < i < n, 

^ ^ 1 0<{h,,X + wt{b„,) + --- + wtibk)). 

The function 6™ (g) • • • ® 6i h-> c) e N" x W\ where for z = 1, • • • , n 
/?, = {e,, A + wt(6,„) + • • • + wt{bi)) 

and 

Ci = min{(ei, A + wt{bm) ^ h wt(6fe)), 1 < fc < m}, 

is a bijection from {6 e B{mAi) : b satisfies conditions to c) G N" x N" : 

A ^ c, /? ^ c, J2i(^i — Ci + Pi — Ci) — to}. Look at Figure [9]to be convinced of the 
bijection. The curve cannot decrease (resp. increase) if the {i — 1)*'* (resp.(i + 
1)*'*) has not since bm®- ■ •<8)6i is an element of B{aei). Moreover the curves remain 
nonnegative and cannot cross each other since < {hi, A + wt{bk) + • • • + wt{b„i)). 
So we get the following proposition. 

Proposition 9.3. Let A, 7 G N" be such that Ai > • • • > A„, and 7 = (to, 0, • • • ,0), 
TO G N. Then 

where the sum is over all /? G N" satisfying /3i > • • • > /3„ such that there exists 
c = (ci, • • • , c„) G N" which verifies X c, f3 ^ c and J27=ii^i — Ci + Pi — Ci) = to. 
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In addition, the multiplicity Mx^j{P) of the irreducible module with highest weight 
(3 is the number of c Cz N" satisfying these relations. 



Ai 
A2 



Cl 



C2 



Pi Ml 



P2 M2 



Ps M3 
^ k 



Figure 9. Irreducible decomposition of V\ (E) Vmei for the type C3 

We invite the reader to compare this figure with figure [H vectors Ri and Ri+i 
(black discs) satisfy the same interlacing conditions as the highest weights A and 
/i, and the white discs verify the same interlacing conditions as c. 

9.1.3. Tensor product of representations for type Bj,. The coroots of the simple 
roots are h^ — ei — ei+i, i — 1, ■ ■ ■ ,r — 1, — 2e,,, the crystal graph of V^^ is 

where i, i and have respective weight e^, —ei and for i = 1, • • • , r. We define an 
order on B(ei) byl<---<r<0<r<---<T. By theorem 5.7.1 of [37|, 

B{mei) = {b„^ (g)---®bie B(ei)^™ : bk+i > bk, bk+i «) &fc 7^ (g) 0}. 

Let A be an integral dominant weight. As for the type C„, in the decomposition 
of Vx ® V^iei the sum ranges over the 6,„ (g) • • • (g) 61 g B{mei) such that £^(6^) < 

(/ij, A + wt{bk+i) H h wt{b„r)) for 1 < A: < m, 1 < i < r. Let 6 G -B(ei). For 

i < r — 1, {h.i,wt{b)) = ~1 if b — i + 1 or b — i. Moreover {hr, wt{b)) = — 2 if 6 = r. 
In every other cases {hi, wt{b)) is positive. Thus one easily shows that 

e.(b) < (h^. A) ^ ( ^0 'fttV'i?^^^ 
^ - ^ ' \ or (6 = and (/ir, A) > 1). 

So, in the decomposition considered, the sum ranges over all elements b^'E ■ ■ ■ 'S)bi G 
B{ei)^"^ satisfying for every (fc, i) £{!,■■■ , m} x {1, • • • , r} 

( bk+i > bk, bk+i®bk 7^0®0 
(29) <^ < {h„X + wt{brn) + ■■■ + wt{bk)) 

[ 1 < {K, A + wt{bm) + ■■■ + wt{bk)) if bk = 0. 
Thus we get the following proposition. 

Proposition 9.4. Let A, 7 G N*" be such that Ai > • • • > Ar and 7 = (m, 0, • • • ,0), 
a e N. Then 

Vx(EV^^ ®pMxrf{P)Vf3 
where the sum is over all /? € N"" such that Pi > ■ ■ ■ > Pr such that there exists an 
integer s e {0, 1} and c £ W which verifies X ^ c, P c and X]I=i(Ai — Q + Pi — 
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a) + s = m, s being equal to if Cr ~ 0. In addition, the multiplicity M\^^{(3) of 
the irreducible module with highest weight [3 is the the number of (c, s) G N*" x {0, 1} 
satisfying these relations. 

9.1.4. Tensor product of representations for type Dr. The simple coroots are hi = 
— fi+i, i — ^, ■ ■ ■ ,T — 1, and hr = er + fr-i, the crystal graph of Ve-^ is 

Biei): li....'^3^_2''-^' r-1 7^ ^^-^^ . . . l^J . 

r — l\ J. y r 

Here i and i have respective weight ti and — e; , i = 1, • • • , r. We define a partial 

^ 

order < on B{ei) byl<---<r — 1< <r — 1<---<1. For m e N theorem 
6.7.1 of [37] states that, 

B(mei) = {b^®---®b^e B(ei)®'" : hk+i < bk}. 

Let A be a dominant weight such that (e.r,A) G N. For 6 G B{ei), the same 
considerations as for the types An-i and C„ imply equivalence (j26p . So that we 
get proposition 19. 5i which is illustrated by figure [TOl We invite the reader to 
compare with figure [T] 

Proposition 9.5. Let A, 7 G N*" be such that Ai > • • • > \Xr\, and 7 — (m, 0, • • • ,0), 
m G N. Then 

where the sum is over all (3 G N'' satisfying (3i > ■ ■ ■ > Pr such that there exists 
c G W^^ which verifiy X c, fi > c, max(|Ar.|, < Cr-i and — Ck + 

Pk — Ck) + |A,- — iJ,r\ = w. In addition, the multiplicity M\,~f{f3) of the irreducible 
module with highest weight (3 is the number of c £ W^^ satisfying these relations. 




^ k 

Pi_ ^3 

m 

Figure 10. Irreducible decomposition of Vx (g) Vmei for the type D3 
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9.2. Classical restriction multiplicities. For F = M,C,H, the branching rules 
when K — J7„(F) and H = ?7„_i(F), are well known (see for instance Knapp [44]). 
Let us recall them. We add a subscript Z to the Gelfand Tetlin polytopes GT„(A) 
to designate the subset of elements with integer entries. 

Proposition 9.6. Let A be an integral point ofCn- Let V\ be an irreducible module 
with highest weight A. The irreducible decomposition \2'^) when K — C/„(F) and 
H = C/„_i(F) is the following one: 

where the sum is over all (3 such that there exists x € GT'„_z(A) such that a;*-"^"'^-' — (3. 
Moreover for F = C, R, m^^__^ {(3) — 1 and for F = H, m^^_^ (/?) is the number of 

c G N" for which there exists x G GTn,z{^) with a;*-"^^-* — (3 and — c. 

10. Asymptotic multiplicities and limit measures 
In this section, we prove lemma 13.31 and proposition 14.31 



10.1. Proof of lemma 13.31 We have recalled in proposition 19.61 the branching 
rules in the case when K — ?7„(F) and H = [/„_i(F). Let us consider the chain 
of subgroups ?7„(F) D • • • D Ui{¥) and the corresponding successive restrictions. 
If we compare the successive branching rules with the definition of the Gelfand- 
Tsetlin polytopes GT„(A) for A an integer point in C„, we get the famous result 
that the number of integer points in Gr„(A) is the dimension of the irreducible 
il„(F)— module with highest weight A. Actually this is the reason why Gelfand- 
Tsetlin polytopes have been introduced [28] . The dimension formula ([20)1 implies 
the following lemma. Let e be equal to 1 if n ^ 2N and otherwise. 

Lemma 10.1. Let A be an integer point in Cn- The number of points in GTn^z{X), 
denoted CardGr„^z(A), is equal to: 

• when F = C, 

- Xj +j - i 



n 

l<'i<j<n 



J - « 



• when F = H, 



n(Ai - \j + j — i)(Ai + Aj ■ + 2n + 2 — j — i) -A- A,; + 71 + 1 — i 
(j - i)(2n + 2- j - i) n + l-i ' 

l<i<j<n \J J\ < J I 



when F : 



[Xi - Xj + j - i){Xi + Xj + 2n + e - j - i) [Xi + n + \ 



{j -i){2n + e-j -i) ^i-l 



1 



l<'i<j<n \J J\ • ■) ) j^]^ 2 



Before writing the proof of the lemma lXHl let us state the following lemma. Recall 
that is the image of the uniform measure on GTn{X) by the map x £ GT„(A) i-^- 
x^"'^^\ and {ek)k>i converges to 0. 
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Lemma 10.2. Let A be in the Weyl chamber Cn- Let us consider a sequence {\k)k>i 
of integer points in C„ such that SkXk converges to X, as k goes to infinity, and the 
associated sequence of measures {p-k)k>o defined as in Theorem \ 7. 3\ for K — [/„(F) 
and H = U„-i{¥). Then {fik)k>i converges to the measure fi\. 

Proof. We use the multiplicity {(3) defined in proposition 19.61 Since the 

dimension of the irreducible il„(F)-module with highest weight 7 is given by the 
number of integer points in GT„(7), we obtain that /i^ is equal to 

.on^ CardGT„„i^z;(/3) .^nc 

^ CardCT„,.(A.) 

Comparing the definition of Gelfand-Tsetlin polytopes with the branching rules 
given in proposition 19.61 we get that the measure ^fc is the image by the map x e 
GTn{ekXk) a;(""^' of the measure J2xeGTr, z(Afc) ^i^kx- This last measure 

converges to the uniform measure on GT„(A). Thus converges to □ 

Proof of lemma [213] : Let A G C„ and U e C/„(F) a Haar distributed random 
variable. We choose a sequence of measures {fJ-k)k>i on C„ as in lemma [10.21 which 
claims that {iik)k>i converges to the law of the radial part of the main minor of 
order n — 1 of U^n{X)U* . Lemma [10.21 implies that this law is □ 

10.2. Proof of proposition 14.31 The following lemma states the connection be- 
tween the set £{X,9) defined in section 4 and irreducible decomposition of tensor 
products of representations studied in section 9. In every case but the real odd one, 
we denote £z{X,6) the subset of £{X,9) whose elements have components in Z. In 
the case where F = M and n 2r + 1 , we let 

£ziX, 9) = {(/3, z, x,s) -kW X GT^^^ x {0, l}:X,Phz, 



E 



(A, + A - 2z,) + s = 9,xe GTn{f}), s = if = 0}. 



=1 



Lemma 10.3. Let X and 7 = (a,0, ...,0) be integer points ofCn- Then the number 
of points in £z{X,a) is equal to dim(A) dim(7). 

Proof. We compare the conditions satisfied by the component (3 of the elements 
of £z{X,a) with those satisfied by the weights appearing in the description of 
the irreducible decomposition of the tensor product V\ ® given in proposi- 
tions [921 to [9?5l Recalling that CardGT„^z(/3) is equal to dim(V/3) we get that 
Card£z(A, a) = X];3 diin(V^), where the sum ranges over the dominant weights (3 
(with their multiplicity) appearing in the irreducible decomposition oi V\®V^. 
Thus Card£z(A, a) = Ami{V^ (g> V^) = dim(A) dim(7). □ 

Lemma 10.4. Let A be in the Weyl chamber Cn and 9 > 0. Let us consider two 
sequences {Xk)k>i o,nd {'Jk)k>i of integer points in Cn such that 7^ can be written 
as (afc, 0, 0). We suppose that euXk converges to X and euau converges to 0, 
as k goes to infinity. Then the associated sequence of measures {h'k)k>i given in 
corollary \7.4\ for K — C/„(F) converges to the measure vx^e- 



Proof. The measure Vk is the measure 
v-^ dim(/3) 



^ dim(Afe) dim(7fe 
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where Mx^^^^{(3) is the muhiphcity of the highest weight (3 in the irreducible de- 
composition of ® Vy^ . The description of this irreducible decomposition given 
in section 9, from proposition l9.2l to l9.5[ and the fact that dim(/3) = CardGTn^zl/?) 
show that Vk is the image by the projection on the component p of the probability 

dim(Afe)dim(7.) ^^'"^^ 

which proves the proposition. □ 

Proof of proposition 14.31 : Let A e C„, e R\_ and choose a sequence of 
measures {vk)k>i on C„ as in lemma [10.41 Then {i'k)k>i converges to the law of the 
radial part of ri„(A) + UVln{0)U* where U has a Haar distribution. Lemma [10.41 
implies that this law is vx.e- □ 

11. Concluding remarks 

11.1. Random processes with values in GTn. Let M ~ {Mt)t>o be a standard 
Brownian motion in Vn{C). Then the minor process X{M) — (X(M())^^g is 
generally not a Markov process. For instance for F = C, the only cases when 
X{M) is a Markov process are for n — 1 and n — 2. Actually a Brownian motion 
in Vn{C) can be obtained as a limit, in a certain sense, of a quantum random walk 
(see Biane [1] for 7^2 (C)). The fact that the minor process X{M) is not Markovian 
has to be related to the fact that for n > 3, the "complete system of observables" 
in the space of any representation defined by Zhelobenko in chap. X.67 of [64], is 
not stable by the Markovian operator of the quantum random walk. 

11.2. Rank one perturbation on classical complex Lie groups. Klyachko 
showed in [43] that the convolution of biinvariant measures on the complexification 
G of the compact group K, is deduced from the convolution of invariant measures 
on K. His result is an hyperbolic version of the so called wrapping map introduced 
by Dooley and Wildberger [5^. Using this we can show that the radial part of a 
Brownian motion on the symmetric space G/K can be approached by an interlaced 
process. 

11.3. Rank one perturbation on U„(F). Let us say a word about some other 
interesting rank one perturbations having invariance properties that we can find 
in literature. For instance, Diaconis and Shahshahani [T7], [T5], followed by Porod 
|55j . [56] and Rosenthal [57], studied specific random walks on J7„(F), F = K,C,H, 
whose increments are some random rotations, in order to approximate the Haar 
measure on J7„(F). The wrapping map introduced in [20 makes a link between 
these rank one perturbations and those that we studied in this paper. 
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